2015-06-13T01:04:44.478+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=14G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-06-13T01:04:44.504+0000 I CONTROL [initandlisten] MongoDB starting : pid=3038 port=27017 dbpath=/home/ec2-user/data/dbs 64-bit host=ip-10-3-1-101 2015-06-13T01:04:44.504+0000 I CONTROL [initandlisten] 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] ** NOTE: This is a development version (3.1.4) of MongoDB. 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] ** Not recommended for production. 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] db version v3.1.4 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] git version: 774e7ce52abbe8ac6adaefd05db2d3273223187c 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.0-fips 29 Mar 2010 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] allocator: tcmalloc 2015-06-13T01:04:44.505+0000 I CONTROL [initandlisten] options: { processManagement: { fork: true }, replication: { replSet: "rs0" }, storage: { dbPath: "/home/ec2-user/data/dbs", engine: "wiredTiger" }, systemLog: { destination: "file", path: "/home/ec2-user/data/logs/mongod.log" } } 2015-06-13T01:04:44.508+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument Did not find replica set lastVote document in local.replset.election 2015-06-13T01:04:44.508+0000 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument Did not find replica set configuration document in local.system.replset 2015-06-13T01:04:44.510+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2015-06-13T01:04:51.776+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56844 #1 (1 connection now open) 2015-06-13T01:04:51.777+0000 I NETWORK [conn1] end connection 10.3.1.100:56844 (0 connections now open) 2015-06-13T01:04:51.777+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56845 #2 (1 connection now open) 2015-06-13T01:04:51.780+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56846 #3 (2 connections now open) 2015-06-13T01:04:51.780+0000 I NETWORK [conn3] end connection 10.3.1.100:56846 (1 connection now open) 2015-06-13T01:04:51.783+0000 I REPL [replExecDBWorker-2] Starting replication applier threads 2015-06-13T01:04:51.783+0000 W REPL [rsSync] did not receive a valid config yet, sleeping 5 seconds 2015-06-13T01:04:51.784+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "rs0", version: 3, members: [ { _id: 0, host: "ip-10-3-1-100:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "10.3.1.101:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatTimeoutSecs: 10, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, protocolVersion: 0 } } 2015-06-13T01:04:51.784+0000 I REPL [ReplicationExecutor] This node is 10.3.1.101:27017 in the config 2015-06-13T01:04:51.784+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2015-06-13T01:04:51.784+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56850 #4 (2 connections now open) 2015-06-13T01:04:51.784+0000 I NETWORK [conn4] end connection 10.3.1.100:56850 (1 connection now open) 2015-06-13T01:04:51.785+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33818 #5 (2 connections now open) 2015-06-13T01:04:51.785+0000 I NETWORK [conn5] end connection 10.3.1.102:33818 (1 connection now open) 2015-06-13T01:04:51.786+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "rs0", version: 4, members: [ { _id: 0, host: "ip-10-3-1-100:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "10.3.1.101:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "10.3.1.102:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatTimeoutSecs: 10, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, protocolVersion: 0 } } 2015-06-13T01:04:51.786+0000 I REPL [ReplicationExecutor] This node is 10.3.1.101:27017 in the config 2015-06-13T01:04:51.787+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state STARTUP 2015-06-13T01:04:51.787+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33819 #6 (2 connections now open) 2015-06-13T01:04:51.789+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "rs0", version: 5, members: [ { _id: 0, host: "ip-10-3-1-100:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "10.3.1.101:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "10.3.1.102:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatTimeoutSecs: 10, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, protocolVersion: 0 } } 2015-06-13T01:04:51.789+0000 I REPL [ReplicationExecutor] This node is 10.3.1.101:27017 in the config 2015-06-13T01:04:51.789+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state PRIMARY 2015-06-13T01:04:51.789+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state STARTUP2 2015-06-13T01:04:51.791+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33821 #7 (3 connections now open) 2015-06-13T01:04:51.791+0000 I NETWORK [conn7] end connection 10.3.1.102:33821 (2 connections now open) 2015-06-13T01:04:56.784+0000 I REPL [rsSync] ****** 2015-06-13T01:04:56.784+0000 I REPL [rsSync] creating replication oplog of size: 3567MB... 2015-06-13T01:04:56.785+0000 I STORAGE [rsSync] Starting WiredTigerRecordStoreThread local.oplog.rs 2015-06-13T01:04:56.799+0000 I REPL [rsSync] ****** 2015-06-13T01:04:56.799+0000 I REPL [rsSync] initial sync pending 2015-06-13T01:04:56.802+0000 I REPL [ReplicationExecutor] syncing from: ip-10-3-1-100:27017 2015-06-13T01:04:56.804+0000 I REPL [rsSync] initial sync drop all databases 2015-06-13T01:04:56.804+0000 I STORAGE [rsSync] dropAllDatabasesExceptLocal 1 2015-06-13T01:04:56.804+0000 I REPL [rsSync] initial sync clone all databases 2015-06-13T01:04:56.805+0000 I REPL [rsSync] initial sync data copy, starting syncup 2015-06-13T01:04:56.805+0000 I REPL [rsSync] oplog sync 1 of 3 2015-06-13T01:04:56.805+0000 I REPL [rsSync] oplog sync 2 of 3 2015-06-13T01:04:56.805+0000 I REPL [rsSync] initial sync building indexes 2015-06-13T01:04:56.805+0000 I REPL [rsSync] oplog sync 3 of 3 2015-06-13T01:04:56.807+0000 I REPL [rsSync] initial sync finishing up 2015-06-13T01:04:56.807+0000 I REPL [rsSync] set minValid=(term: 0, timestamp: Jun 13 01:04:51:4) 2015-06-13T01:04:56.807+0000 I REPL [rsSync] initial sync done 2015-06-13T01:04:56.809+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2015-06-13T01:04:56.810+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2015-06-13T01:04:57.785+0000 I REPL [ReplicationExecutor] could not find member to sync from 2015-06-13T01:04:57.789+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state SECONDARY 2015-06-13T01:05:21.798+0000 I NETWORK [conn2] end connection 10.3.1.100:56845 (1 connection now open) 2015-06-13T01:05:21.798+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56853 #8 (2 connections now open) 2015-06-13T01:05:21.803+0000 I NETWORK [conn6] end connection 10.3.1.102:33819 (1 connection now open) 2015-06-13T01:05:21.803+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33824 #9 (2 connections now open) 2015-06-13T01:05:32.792+0000 I REPL [ReplicationExecutor] syncing from: ip-10-3-1-100:27017 2015-06-13T01:05:32.798+0000 I INDEX [repl writer worker 15] build index on: ycsb.usertable properties: { v: 1, key: { _id: "hashed" }, name: "_id_hashed", ns: "ycsb.usertable" } 2015-06-13T01:05:32.798+0000 I INDEX [repl writer worker 15] building index using bulk method 2015-06-13T01:05:32.799+0000 I INDEX [repl writer worker 15] build index done. scanned 0 total records. 0 secs 2015-06-13T01:05:32.812+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to ip-10-3-1-100:27017 2015-06-13T01:05:40.130+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41105 #10 (3 connections now open) 2015-06-13T01:05:41.452+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.103:53710 #11 (4 connections now open) 2015-06-13T01:05:51.806+0000 I NETWORK [conn8] end connection 10.3.1.100:56853 (3 connections now open) 2015-06-13T01:05:51.806+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56881 #12 (4 connections now open) 2015-06-13T01:05:51.810+0000 I NETWORK [conn9] end connection 10.3.1.102:33824 (3 connections now open) 2015-06-13T01:05:51.811+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33828 #13 (4 connections now open) 2015-06-13T01:06:21.816+0000 I NETWORK [conn12] end connection 10.3.1.100:56881 (3 connections now open) 2015-06-13T01:06:21.816+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56886 #14 (4 connections now open) 2015-06-13T01:06:21.825+0000 I NETWORK [conn13] end connection 10.3.1.102:33828 (3 connections now open) 2015-06-13T01:06:21.825+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33830 #15 (4 connections now open) 2015-06-13T01:06:51.829+0000 I NETWORK [conn14] end connection 10.3.1.100:56886 (3 connections now open) 2015-06-13T01:06:51.829+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56888 #16 (4 connections now open) 2015-06-13T01:06:51.831+0000 I NETWORK [conn15] end connection 10.3.1.102:33830 (3 connections now open) 2015-06-13T01:06:51.832+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33832 #17 (4 connections now open) 2015-06-13T01:06:57.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46776 #18 (5 connections now open) 2015-06-13T01:07:21.839+0000 I NETWORK [conn16] end connection 10.3.1.100:56888 (4 connections now open) 2015-06-13T01:07:21.839+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56890 #19 (5 connections now open) 2015-06-13T01:07:21.844+0000 I NETWORK [conn17] end connection 10.3.1.102:33832 (4 connections now open) 2015-06-13T01:07:21.844+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33834 #20 (5 connections now open) 2015-06-13T01:07:22.364+0000 I NETWORK [conn18] end connection 127.0.0.1:46776 (4 connections now open) 2015-06-13T01:07:51.848+0000 I NETWORK [conn19] end connection 10.3.1.100:56890 (3 connections now open) 2015-06-13T01:07:51.848+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56892 #21 (4 connections now open) 2015-06-13T01:07:51.855+0000 I NETWORK [conn20] end connection 10.3.1.102:33834 (3 connections now open) 2015-06-13T01:07:51.855+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33836 #22 (4 connections now open) 2015-06-13T01:08:21.855+0000 I NETWORK [conn21] end connection 10.3.1.100:56892 (3 connections now open) 2015-06-13T01:08:21.855+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56894 #23 (4 connections now open) 2015-06-13T01:08:21.865+0000 I NETWORK [conn22] end connection 10.3.1.102:33836 (3 connections now open) 2015-06-13T01:08:21.866+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33838 #24 (4 connections now open) 2015-06-13T01:08:51.866+0000 I NETWORK [conn23] end connection 10.3.1.100:56894 (3 connections now open) 2015-06-13T01:08:51.866+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56896 #25 (4 connections now open) 2015-06-13T01:08:51.876+0000 I NETWORK [conn24] end connection 10.3.1.102:33838 (3 connections now open) 2015-06-13T01:08:51.876+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33840 #26 (4 connections now open) 2015-06-13T01:09:21.874+0000 I NETWORK [conn25] end connection 10.3.1.100:56896 (3 connections now open) 2015-06-13T01:09:21.874+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56898 #27 (4 connections now open) 2015-06-13T01:09:21.887+0000 I NETWORK [conn26] end connection 10.3.1.102:33840 (3 connections now open) 2015-06-13T01:09:21.887+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33842 #28 (4 connections now open) 2015-06-13T01:09:51.884+0000 I NETWORK [conn27] end connection 10.3.1.100:56898 (3 connections now open) 2015-06-13T01:09:51.884+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56900 #29 (4 connections now open) 2015-06-13T01:09:51.895+0000 I NETWORK [conn28] end connection 10.3.1.102:33842 (3 connections now open) 2015-06-13T01:09:51.896+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33844 #30 (4 connections now open) 2015-06-13T01:10:21.894+0000 I NETWORK [conn29] end connection 10.3.1.100:56900 (3 connections now open) 2015-06-13T01:10:21.894+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56902 #31 (4 connections now open) 2015-06-13T01:10:21.905+0000 I NETWORK [conn30] end connection 10.3.1.102:33844 (3 connections now open) 2015-06-13T01:10:21.905+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33846 #32 (4 connections now open) 2015-06-13T01:10:51.904+0000 I NETWORK [conn31] end connection 10.3.1.100:56902 (3 connections now open) 2015-06-13T01:10:51.905+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56904 #33 (4 connections now open) 2015-06-13T01:10:51.914+0000 I NETWORK [conn32] end connection 10.3.1.102:33846 (3 connections now open) 2015-06-13T01:10:51.914+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33848 #34 (4 connections now open) 2015-06-13T01:11:21.920+0000 I NETWORK [conn33] end connection 10.3.1.100:56904 (3 connections now open) 2015-06-13T01:11:21.920+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56906 #35 (4 connections now open) 2015-06-13T01:11:21.926+0000 I NETWORK [conn34] end connection 10.3.1.102:33848 (3 connections now open) 2015-06-13T01:11:21.926+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33850 #36 (4 connections now open) 2015-06-13T01:11:51.929+0000 I NETWORK [conn35] end connection 10.3.1.100:56906 (3 connections now open) 2015-06-13T01:11:51.930+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56908 #37 (4 connections now open) 2015-06-13T01:11:51.936+0000 I NETWORK [conn36] end connection 10.3.1.102:33850 (3 connections now open) 2015-06-13T01:11:51.936+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33852 #38 (4 connections now open) 2015-06-13T01:12:21.935+0000 I NETWORK [conn37] end connection 10.3.1.100:56908 (3 connections now open) 2015-06-13T01:12:21.936+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56910 #39 (4 connections now open) 2015-06-13T01:12:21.944+0000 I NETWORK [conn38] end connection 10.3.1.102:33852 (3 connections now open) 2015-06-13T01:12:21.944+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33854 #40 (4 connections now open) 2015-06-13T01:12:51.943+0000 I NETWORK [conn39] end connection 10.3.1.100:56910 (3 connections now open) 2015-06-13T01:12:51.943+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56912 #41 (4 connections now open) 2015-06-13T01:12:51.952+0000 I NETWORK [conn40] end connection 10.3.1.102:33854 (3 connections now open) 2015-06-13T01:12:51.952+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33856 #42 (4 connections now open) 2015-06-13T01:13:21.953+0000 I NETWORK [conn41] end connection 10.3.1.100:56912 (3 connections now open) 2015-06-13T01:13:21.954+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56914 #43 (4 connections now open) 2015-06-13T01:13:21.965+0000 I NETWORK [conn42] end connection 10.3.1.102:33856 (3 connections now open) 2015-06-13T01:13:21.965+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33858 #44 (4 connections now open) 2015-06-13T01:13:51.964+0000 I NETWORK [conn43] end connection 10.3.1.100:56914 (3 connections now open) 2015-06-13T01:13:51.964+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56916 #45 (4 connections now open) 2015-06-13T01:13:51.975+0000 I NETWORK [conn44] end connection 10.3.1.102:33858 (3 connections now open) 2015-06-13T01:13:51.976+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33860 #46 (4 connections now open) 2015-06-13T01:14:21.975+0000 I NETWORK [conn45] end connection 10.3.1.100:56916 (3 connections now open) 2015-06-13T01:14:21.976+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56918 #47 (4 connections now open) 2015-06-13T01:14:21.986+0000 I NETWORK [conn46] end connection 10.3.1.102:33860 (3 connections now open) 2015-06-13T01:14:21.986+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33862 #48 (4 connections now open) 2015-06-13T01:14:35.707+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46808 #49 (5 connections now open) 2015-06-13T01:14:51.985+0000 I NETWORK [conn47] end connection 10.3.1.100:56918 (4 connections now open) 2015-06-13T01:14:51.985+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56944 #50 (5 connections now open) 2015-06-13T01:14:51.994+0000 I NETWORK [conn48] end connection 10.3.1.102:33862 (4 connections now open) 2015-06-13T01:14:51.994+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33865 #51 (5 connections now open) 2015-06-13T01:15:21.994+0000 I NETWORK [conn50] end connection 10.3.1.100:56944 (4 connections now open) 2015-06-13T01:15:21.995+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:56992 #52 (5 connections now open) 2015-06-13T01:15:22.004+0000 I NETWORK [conn51] end connection 10.3.1.102:33865 (4 connections now open) 2015-06-13T01:15:22.004+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33867 #53 (5 connections now open) 2015-06-13T01:15:52.004+0000 I NETWORK [conn52] end connection 10.3.1.100:56992 (4 connections now open) 2015-06-13T01:15:52.005+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57015 #54 (5 connections now open) 2015-06-13T01:15:52.013+0000 I NETWORK [conn53] end connection 10.3.1.102:33867 (4 connections now open) 2015-06-13T01:15:52.013+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33869 #55 (5 connections now open) 2015-06-13T01:16:22.021+0000 I NETWORK [conn54] end connection 10.3.1.100:57015 (4 connections now open) 2015-06-13T01:16:22.021+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57096 #56 (5 connections now open) 2015-06-13T01:16:22.025+0000 I NETWORK [conn55] end connection 10.3.1.102:33869 (4 connections now open) 2015-06-13T01:16:22.025+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33871 #57 (5 connections now open) 2015-06-13T01:16:52.032+0000 I NETWORK [conn57] end connection 10.3.1.102:33871 (4 connections now open) 2015-06-13T01:16:52.032+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33873 #58 (5 connections now open) 2015-06-13T01:16:52.032+0000 I NETWORK [conn56] end connection 10.3.1.100:57096 (4 connections now open) 2015-06-13T01:16:52.033+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57125 #59 (5 connections now open) 2015-06-13T01:17:22.039+0000 I NETWORK [conn58] end connection 10.3.1.102:33873 (4 connections now open) 2015-06-13T01:17:22.039+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33875 #60 (5 connections now open) 2015-06-13T01:17:22.040+0000 I NETWORK [conn59] end connection 10.3.1.100:57125 (4 connections now open) 2015-06-13T01:17:22.040+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57181 #61 (5 connections now open) 2015-06-13T01:17:52.046+0000 I NETWORK [conn60] end connection 10.3.1.102:33875 (4 connections now open) 2015-06-13T01:17:52.046+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33877 #62 (5 connections now open) 2015-06-13T01:17:52.055+0000 I NETWORK [conn61] end connection 10.3.1.100:57181 (4 connections now open) 2015-06-13T01:17:52.055+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57261 #63 (5 connections now open) 2015-06-13T01:18:22.056+0000 I NETWORK [conn62] end connection 10.3.1.102:33877 (4 connections now open) 2015-06-13T01:18:22.056+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33879 #64 (5 connections now open) 2015-06-13T01:18:22.073+0000 I NETWORK [conn63] end connection 10.3.1.100:57261 (4 connections now open) 2015-06-13T01:18:22.073+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57321 #65 (5 connections now open) 2015-06-13T01:18:52.069+0000 I NETWORK [conn64] end connection 10.3.1.102:33879 (4 connections now open) 2015-06-13T01:18:52.069+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33881 #66 (5 connections now open) 2015-06-13T01:18:52.080+0000 I NETWORK [conn65] end connection 10.3.1.100:57321 (4 connections now open) 2015-06-13T01:18:52.081+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57340 #67 (5 connections now open) 2015-06-13T01:19:22.077+0000 I NETWORK [conn66] end connection 10.3.1.102:33881 (4 connections now open) 2015-06-13T01:19:22.077+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33883 #68 (5 connections now open) 2015-06-13T01:19:22.094+0000 I NETWORK [conn67] end connection 10.3.1.100:57340 (4 connections now open) 2015-06-13T01:19:22.097+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57382 #69 (5 connections now open) 2015-06-13T01:19:52.082+0000 I NETWORK [conn68] end connection 10.3.1.102:33883 (4 connections now open) 2015-06-13T01:19:52.083+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33885 #70 (5 connections now open) 2015-06-13T01:19:52.123+0000 I NETWORK [conn69] end connection 10.3.1.100:57382 (4 connections now open) 2015-06-13T01:19:52.124+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57388 #71 (5 connections now open) 2015-06-13T01:20:22.096+0000 I NETWORK [conn70] end connection 10.3.1.102:33885 (4 connections now open) 2015-06-13T01:20:22.096+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33887 #72 (5 connections now open) 2015-06-13T01:20:22.138+0000 I NETWORK [conn71] end connection 10.3.1.100:57388 (4 connections now open) 2015-06-13T01:20:22.138+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57410 #73 (5 connections now open) 2015-06-13T01:20:52.109+0000 I NETWORK [conn72] end connection 10.3.1.102:33887 (4 connections now open) 2015-06-13T01:20:52.112+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33888 #74 (5 connections now open) 2015-06-13T01:20:52.147+0000 I NETWORK [conn73] end connection 10.3.1.100:57410 (4 connections now open) 2015-06-13T01:20:52.148+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57454 #75 (5 connections now open) 2015-06-13T01:21:22.123+0000 I NETWORK [conn74] end connection 10.3.1.102:33888 (4 connections now open) 2015-06-13T01:21:22.123+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33890 #76 (5 connections now open) 2015-06-13T01:21:22.168+0000 I NETWORK [conn75] end connection 10.3.1.100:57454 (4 connections now open) 2015-06-13T01:21:22.168+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57504 #77 (5 connections now open) 2015-06-13T01:21:52.128+0000 I NETWORK [conn76] end connection 10.3.1.102:33890 (4 connections now open) 2015-06-13T01:21:52.129+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33893 #78 (5 connections now open) 2015-06-13T01:21:52.181+0000 I NETWORK [conn77] end connection 10.3.1.100:57504 (4 connections now open) 2015-06-13T01:21:52.182+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57560 #79 (5 connections now open) 2015-06-13T01:22:22.137+0000 I NETWORK [conn78] end connection 10.3.1.102:33893 (4 connections now open) 2015-06-13T01:22:22.137+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33895 #80 (5 connections now open) 2015-06-13T01:22:22.195+0000 I NETWORK [conn79] end connection 10.3.1.100:57560 (4 connections now open) 2015-06-13T01:22:22.195+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57589 #81 (5 connections now open) 2015-06-13T01:22:52.144+0000 I NETWORK [conn80] end connection 10.3.1.102:33895 (4 connections now open) 2015-06-13T01:22:52.144+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33897 #82 (5 connections now open) 2015-06-13T01:22:52.224+0000 I NETWORK [conn81] end connection 10.3.1.100:57589 (4 connections now open) 2015-06-13T01:22:52.225+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57684 #83 (5 connections now open) 2015-06-13T01:23:22.153+0000 I NETWORK [conn82] end connection 10.3.1.102:33897 (4 connections now open) 2015-06-13T01:23:22.154+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33899 #84 (5 connections now open) 2015-06-13T01:23:22.238+0000 I NETWORK [conn83] end connection 10.3.1.100:57684 (4 connections now open) 2015-06-13T01:23:22.238+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57711 #85 (5 connections now open) 2015-06-13T01:23:52.163+0000 I NETWORK [conn84] end connection 10.3.1.102:33899 (4 connections now open) 2015-06-13T01:23:52.163+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33901 #86 (5 connections now open) 2015-06-13T01:23:52.248+0000 I NETWORK [conn85] end connection 10.3.1.100:57711 (4 connections now open) 2015-06-13T01:23:52.253+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57848 #87 (5 connections now open) 2015-06-13T01:24:22.176+0000 I NETWORK [conn86] end connection 10.3.1.102:33901 (4 connections now open) 2015-06-13T01:24:22.177+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33903 #88 (5 connections now open) 2015-06-13T01:24:22.264+0000 I NETWORK [conn87] end connection 10.3.1.100:57848 (4 connections now open) 2015-06-13T01:24:22.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57889 #89 (5 connections now open) 2015-06-13T01:24:52.187+0000 I NETWORK [conn88] end connection 10.3.1.102:33903 (4 connections now open) 2015-06-13T01:24:52.187+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33905 #90 (5 connections now open) 2015-06-13T01:24:52.278+0000 I NETWORK [conn89] end connection 10.3.1.100:57889 (4 connections now open) 2015-06-13T01:24:52.279+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57924 #91 (5 connections now open) 2015-06-13T01:25:22.196+0000 I NETWORK [conn90] end connection 10.3.1.102:33905 (4 connections now open) 2015-06-13T01:25:22.196+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33907 #92 (5 connections now open) 2015-06-13T01:25:22.290+0000 I NETWORK [conn91] end connection 10.3.1.100:57924 (4 connections now open) 2015-06-13T01:25:22.291+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57956 #93 (5 connections now open) 2015-06-13T01:25:52.208+0000 I NETWORK [conn92] end connection 10.3.1.102:33907 (4 connections now open) 2015-06-13T01:25:52.209+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33909 #94 (5 connections now open) 2015-06-13T01:25:52.311+0000 I NETWORK [conn93] end connection 10.3.1.100:57956 (4 connections now open) 2015-06-13T01:25:52.316+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57986 #95 (5 connections now open) 2015-06-13T01:26:22.222+0000 I NETWORK [conn94] end connection 10.3.1.102:33909 (4 connections now open) 2015-06-13T01:26:22.223+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33911 #96 (5 connections now open) 2015-06-13T01:26:22.328+0000 I NETWORK [conn95] end connection 10.3.1.100:57986 (4 connections now open) 2015-06-13T01:26:22.328+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57991 #97 (5 connections now open) 2015-06-13T01:26:52.232+0000 I NETWORK [conn96] end connection 10.3.1.102:33911 (4 connections now open) 2015-06-13T01:26:52.232+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33913 #98 (5 connections now open) 2015-06-13T01:26:52.347+0000 I NETWORK [conn97] end connection 10.3.1.100:57991 (4 connections now open) 2015-06-13T01:26:52.348+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:57999 #99 (5 connections now open) 2015-06-13T01:27:22.241+0000 I NETWORK [conn98] end connection 10.3.1.102:33913 (4 connections now open) 2015-06-13T01:27:22.241+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33915 #100 (5 connections now open) 2015-06-13T01:27:22.362+0000 I NETWORK [conn99] end connection 10.3.1.100:57999 (4 connections now open) 2015-06-13T01:27:22.369+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58028 #101 (5 connections now open) 2015-06-13T01:27:52.251+0000 I NETWORK [conn100] end connection 10.3.1.102:33915 (4 connections now open) 2015-06-13T01:27:52.251+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33917 #102 (5 connections now open) 2015-06-13T01:27:52.386+0000 I NETWORK [conn101] end connection 10.3.1.100:58028 (4 connections now open) 2015-06-13T01:27:52.389+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58107 #103 (5 connections now open) 2015-06-13T01:28:22.263+0000 I NETWORK [conn102] end connection 10.3.1.102:33917 (4 connections now open) 2015-06-13T01:28:22.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33919 #104 (5 connections now open) 2015-06-13T01:28:22.404+0000 I NETWORK [conn103] end connection 10.3.1.100:58107 (4 connections now open) 2015-06-13T01:28:22.405+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58145 #105 (5 connections now open) 2015-06-13T01:28:52.273+0000 I NETWORK [conn104] end connection 10.3.1.102:33919 (4 connections now open) 2015-06-13T01:28:52.273+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33921 #106 (5 connections now open) 2015-06-13T01:28:52.422+0000 I NETWORK [conn105] end connection 10.3.1.100:58145 (4 connections now open) 2015-06-13T01:28:52.423+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58204 #107 (5 connections now open) 2015-06-13T01:29:22.287+0000 I NETWORK [conn106] end connection 10.3.1.102:33921 (4 connections now open) 2015-06-13T01:29:22.288+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33923 #108 (5 connections now open) 2015-06-13T01:29:22.451+0000 I NETWORK [conn107] end connection 10.3.1.100:58204 (4 connections now open) 2015-06-13T01:29:22.451+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58266 #109 (5 connections now open) 2015-06-13T01:29:52.301+0000 I NETWORK [conn108] end connection 10.3.1.102:33923 (4 connections now open) 2015-06-13T01:29:52.301+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33925 #110 (5 connections now open) 2015-06-13T01:29:52.460+0000 I NETWORK [conn109] end connection 10.3.1.100:58266 (4 connections now open) 2015-06-13T01:29:52.461+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58277 #111 (5 connections now open) 2015-06-13T01:30:22.310+0000 I NETWORK [conn110] end connection 10.3.1.102:33925 (4 connections now open) 2015-06-13T01:30:22.311+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33927 #112 (5 connections now open) 2015-06-13T01:30:22.475+0000 I NETWORK [conn111] end connection 10.3.1.100:58277 (4 connections now open) 2015-06-13T01:30:22.475+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58288 #113 (5 connections now open) 2015-06-13T01:30:52.322+0000 I NETWORK [conn112] end connection 10.3.1.102:33927 (4 connections now open) 2015-06-13T01:30:52.322+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33929 #114 (5 connections now open) 2015-06-13T01:30:52.485+0000 I NETWORK [conn113] end connection 10.3.1.100:58288 (4 connections now open) 2015-06-13T01:30:52.486+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58317 #115 (5 connections now open) 2015-06-13T01:31:22.331+0000 I NETWORK [conn114] end connection 10.3.1.102:33929 (4 connections now open) 2015-06-13T01:31:22.332+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33931 #116 (5 connections now open) 2015-06-13T01:31:22.499+0000 I NETWORK [conn115] end connection 10.3.1.100:58317 (4 connections now open) 2015-06-13T01:31:22.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58394 #117 (5 connections now open) 2015-06-13T01:31:52.340+0000 I NETWORK [conn116] end connection 10.3.1.102:33931 (4 connections now open) 2015-06-13T01:31:52.341+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33933 #118 (5 connections now open) 2015-06-13T01:31:52.514+0000 I NETWORK [conn117] end connection 10.3.1.100:58394 (4 connections now open) 2015-06-13T01:31:52.514+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58492 #119 (6 connections now open) 2015-06-13T01:32:11.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46879 #120 (6 connections now open) 2015-06-13T01:32:22.350+0000 I NETWORK [conn118] end connection 10.3.1.102:33933 (5 connections now open) 2015-06-13T01:32:22.351+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33936 #121 (6 connections now open) 2015-06-13T01:32:22.544+0000 I NETWORK [conn119] end connection 10.3.1.100:58492 (5 connections now open) 2015-06-13T01:32:22.544+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58510 #122 (6 connections now open) 2015-06-13T01:32:52.361+0000 I NETWORK [conn121] end connection 10.3.1.102:33936 (5 connections now open) 2015-06-13T01:32:52.361+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33938 #123 (6 connections now open) 2015-06-13T01:32:52.555+0000 I NETWORK [conn122] end connection 10.3.1.100:58510 (5 connections now open) 2015-06-13T01:32:52.556+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58515 #124 (6 connections now open) 2015-06-13T01:33:22.373+0000 I NETWORK [conn123] end connection 10.3.1.102:33938 (5 connections now open) 2015-06-13T01:33:22.374+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33940 #125 (6 connections now open) 2015-06-13T01:33:22.570+0000 I NETWORK [conn124] end connection 10.3.1.100:58515 (5 connections now open) 2015-06-13T01:33:22.571+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58526 #126 (6 connections now open) 2015-06-13T01:33:52.387+0000 I NETWORK [conn125] end connection 10.3.1.102:33940 (5 connections now open) 2015-06-13T01:33:52.387+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33942 #127 (7 connections now open) 2015-06-13T01:33:52.583+0000 I NETWORK [conn126] end connection 10.3.1.100:58526 (5 connections now open) 2015-06-13T01:33:52.583+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58528 #128 (6 connections now open) 2015-06-13T01:34:22.445+0000 I NETWORK [conn127] end connection 10.3.1.102:33942 (5 connections now open) 2015-06-13T01:34:22.445+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33944 #129 (6 connections now open) 2015-06-13T01:34:22.598+0000 I NETWORK [conn128] end connection 10.3.1.100:58528 (5 connections now open) 2015-06-13T01:34:22.598+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58530 #130 (6 connections now open) 2015-06-13T01:34:52.459+0000 I NETWORK [conn129] end connection 10.3.1.102:33944 (5 connections now open) 2015-06-13T01:34:52.460+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33946 #131 (6 connections now open) 2015-06-13T01:34:52.619+0000 I NETWORK [conn130] end connection 10.3.1.100:58530 (5 connections now open) 2015-06-13T01:34:52.619+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58541 #132 (6 connections now open) 2015-06-13T01:35:22.474+0000 I NETWORK [conn131] end connection 10.3.1.102:33946 (5 connections now open) 2015-06-13T01:35:22.474+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33948 #133 (7 connections now open) 2015-06-13T01:35:22.633+0000 I NETWORK [conn132] end connection 10.3.1.100:58541 (5 connections now open) 2015-06-13T01:35:25.213+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58555 #134 (6 connections now open) 2015-06-13T01:35:53.223+0000 I NETWORK [conn133] end connection 10.3.1.102:33948 (5 connections now open) 2015-06-13T01:35:53.223+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33951 #135 (6 connections now open) 2015-06-13T01:35:53.224+0000 I NETWORK [conn134] end connection 10.3.1.100:58555 (5 connections now open) 2015-06-13T01:35:53.224+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58564 #136 (6 connections now open) 2015-06-13T01:36:23.233+0000 I NETWORK [conn136] end connection 10.3.1.100:58564 (5 connections now open) 2015-06-13T01:36:23.234+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58566 #137 (6 connections now open) 2015-06-13T01:36:23.237+0000 I NETWORK [conn135] end connection 10.3.1.102:33951 (5 connections now open) 2015-06-13T01:36:23.238+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33953 #138 (6 connections now open) 2015-06-13T01:36:53.246+0000 I NETWORK [conn137] end connection 10.3.1.100:58566 (5 connections now open) 2015-06-13T01:36:53.247+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58568 #139 (6 connections now open) 2015-06-13T01:36:53.252+0000 I NETWORK [conn138] end connection 10.3.1.102:33953 (5 connections now open) 2015-06-13T01:36:53.252+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33955 #140 (6 connections now open) 2015-06-13T01:37:23.258+0000 I NETWORK [conn139] end connection 10.3.1.100:58568 (5 connections now open) 2015-06-13T01:37:23.258+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58570 #141 (6 connections now open) 2015-06-13T01:37:23.267+0000 I NETWORK [conn140] end connection 10.3.1.102:33955 (5 connections now open) 2015-06-13T01:37:23.267+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33957 #142 (6 connections now open) 2015-06-13T01:37:53.280+0000 I NETWORK [conn142] end connection 10.3.1.102:33957 (5 connections now open) 2015-06-13T01:37:53.280+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33959 #143 (6 connections now open) 2015-06-13T01:37:53.281+0000 I NETWORK [conn141] end connection 10.3.1.100:58570 (5 connections now open) 2015-06-13T01:37:53.281+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58581 #144 (6 connections now open) 2015-06-13T01:38:23.289+0000 I NETWORK [conn143] end connection 10.3.1.102:33959 (5 connections now open) 2015-06-13T01:38:23.290+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33961 #145 (6 connections now open) 2015-06-13T01:38:23.317+0000 I NETWORK [conn144] end connection 10.3.1.100:58581 (5 connections now open) 2015-06-13T01:38:23.317+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58583 #146 (6 connections now open) 2015-06-13T01:38:53.303+0000 I NETWORK [conn145] end connection 10.3.1.102:33961 (5 connections now open) 2015-06-13T01:38:53.303+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33963 #147 (7 connections now open) 2015-06-13T01:38:53.329+0000 I NETWORK [conn146] end connection 10.3.1.100:58583 (5 connections now open) 2015-06-13T01:38:53.598+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58585 #148 (7 connections now open) 2015-06-13T01:39:23.609+0000 I NETWORK [conn148] end connection 10.3.1.100:58585 (5 connections now open) 2015-06-13T01:39:23.609+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58587 #149 (6 connections now open) 2015-06-13T01:39:23.610+0000 I NETWORK [conn147] end connection 10.3.1.102:33963 (5 connections now open) 2015-06-13T01:39:23.610+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33965 #150 (6 connections now open) 2015-06-13T01:39:32.646+0000 I NETWORK [ReplExecNetThread-4] Socket recv() timeout 10.3.1.100:27017 2015-06-13T01:39:32.646+0000 I NETWORK [ReplExecNetThread-4] SocketException: remote: 10.3.1.100:27017 error: 9001 socket exception [RECV_TIMEOUT] server [10.3.1.100:27017] 2015-06-13T01:39:32.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to ip-10-3-1-100:27017; HostUnreachable network error while attempting to run command 'replSetHeartbeat' on host 'ip-10-3-1-100:27017' with arguments '{ replSetHeartbeat: "rs0", pv: 1, v: 5, from: "10.3.1.101:27017", fromId: 1, checkEmpty: false }' and metadata '{}' 2015-06-13T01:39:32.653+0000 I REPL [ReplicationExecutor] Standing for election 2015-06-13T01:39:32.656+0000 I REPL [ReplicationExecutor] running for election 2015-06-13T01:39:32.657+0000 I REPL [ReplicationExecutor] received vote: 1 votes from 10.3.1.102:27017 2015-06-13T01:39:32.657+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role 2015-06-13T01:39:32.657+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2015-06-13T01:39:37.592+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2015-06-13T01:39:38.261+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state PRIMARY 2015-06-13T01:39:38.261+0000 I REPL [ReplicationExecutor] another primary seen with election time 557b81b1:2 my election time is 557b89d4:1 2015-06-13T01:39:38.261+0000 I REPL [ReplicationExecutor] another PRIMARY detected and it should step down since it was elected earlier than me 2015-06-13T01:39:38.261+0000 I REPL [ReplicationExecutor] Requesting ip-10-3-1-100:27017 step down from primary 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41370 #151 (7 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41371 #152 (8 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41372 #153 (9 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41373 #154 (10 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41374 #155 (11 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41376 #156 (12 connections now open) 2015-06-13T01:39:38.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41375 #157 (13 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41378 #158 (14 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41377 #159 (15 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41379 #160 (16 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41380 #161 (17 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41382 #162 (18 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41383 #163 (19 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41381 #164 (20 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41386 #165 (21 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41385 #166 (22 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41384 #167 (23 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41387 #168 (24 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41388 #169 (25 connections now open) 2015-06-13T01:39:38.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41389 #170 (26 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41390 #171 (27 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41391 #172 (28 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41392 #173 (29 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41393 #174 (30 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41394 #175 (31 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41396 #176 (32 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41395 #177 (33 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41397 #178 (34 connections now open) 2015-06-13T01:39:38.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41398 #179 (35 connections now open) 2015-06-13T01:39:38.265+0000 I SHARDING [conn158] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41403 #180 (36 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41405 #181 (37 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41409 #182 (38 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41411 #183 (39 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41410 #184 (40 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41412 #185 (41 connections now open) 2015-06-13T01:39:38.265+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41414 #186 (42 connections now open) 2015-06-13T01:39:38.266+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41418 #187 (43 connections now open) 2015-06-13T01:39:38.266+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41419 #188 (44 connections now open) 2015-06-13T01:39:38.266+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41420 #189 (45 connections now open) 2015-06-13T01:39:38.268+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41421 #190 (46 connections now open) 2015-06-13T01:39:38.270+0000 I SHARDING [conn171] remote client 10.3.1.99:41390 initialized this host (rs0/10.3.1.101:27017,10.3.1.102:27017,ip-10-3-1-100:27017) as shard rs0 2015-06-13T01:39:38.271+0000 I SHARDING [conn153] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1039||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:39:38.271+0000 I SHARDING [conn171] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1039||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:39:38.271+0000 I SHARDING [conn166] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1039||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:39:38.271+0000 I NETWORK [conn166] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.271+0000 I NETWORK [conn171] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.271+0000 I NETWORK [conn153] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.272+0000 I NETWORK [conn171] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.272+0000 I NETWORK [conn153] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.272+0000 I NETWORK [conn166] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.273+0000 I NETWORK [conn166] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.273+0000 I NETWORK [conn153] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.273+0000 I NETWORK [conn171] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.285+0000 I SHARDING [conn171] collection ycsb.usertable was previously unsharded, new metadata loaded with shard version 2|1039||557b81da73ba23d09dea68fa 2015-06-13T01:39:38.285+0000 I SHARDING [conn171] collection version was loaded at version 2|1039||557b81da73ba23d09dea68fa, took 14ms 2015-06-13T01:39:38.286+0000 I SHARDING [conn153] metadata of collection ycsb.usertable already up to date (shard version : 2|1039||557b81da73ba23d09dea68fa, took 15ms) 2015-06-13T01:39:38.286+0000 I SHARDING [conn166] metadata of collection ycsb.usertable already up to date (shard version : 2|1039||557b81da73ba23d09dea68fa, took 15ms) 2015-06-13T01:39:38.436+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41422 #191 (47 connections now open) 2015-06-13T01:39:38.440+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41423 #192 (48 connections now open) 2015-06-13T01:39:38.440+0000 I SHARDING [conn192] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9152914018267782020 } 2015-06-13T01:39:38.459+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41424 #193 (49 connections now open) 2015-06-13T01:39:38.459+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41425 #194 (50 connections now open) 2015-06-13T01:39:38.460+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41426 #195 (51 connections now open) 2015-06-13T01:39:38.461+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41427 #196 (52 connections now open) 2015-06-13T01:39:38.461+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41428 #197 (53 connections now open) 2015-06-13T01:39:38.461+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41429 #198 (54 connections now open) 2015-06-13T01:39:38.461+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41430 #199 (55 connections now open) 2015-06-13T01:39:38.477+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41431 #200 (56 connections now open) 2015-06-13T01:39:38.478+0000 I SHARDING [conn200] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9152914018267782020 } 2015-06-13T01:39:38.496+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41432 #201 (57 connections now open) 2015-06-13T01:39:38.496+0000 I SHARDING [conn201] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9152914018267782020 } 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41433 #202 (58 connections now open) 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41434 #203 (59 connections now open) 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41435 #204 (60 connections now open) 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41436 #205 (61 connections now open) 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41438 #206 (62 connections now open) 2015-06-13T01:39:38.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41437 #207 (63 connections now open) 2015-06-13T01:39:38.500+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41439 #208 (64 connections now open) 2015-06-13T01:39:38.500+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41440 #209 (65 connections now open) 2015-06-13T01:39:38.500+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41441 #210 (66 connections now open) 2015-06-13T01:39:38.500+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41442 #211 (67 connections now open) 2015-06-13T01:39:38.500+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41443 #212 (68 connections now open) 2015-06-13T01:39:38.501+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41444 #213 (69 connections now open) 2015-06-13T01:39:38.501+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41445 #214 (70 connections now open) 2015-06-13T01:39:38.502+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41446 #215 (71 connections now open) 2015-06-13T01:39:38.503+0000 I SHARDING [conn215] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9152914018267782020 } 2015-06-13T01:39:38.505+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41448 #216 (72 connections now open) 2015-06-13T01:39:38.505+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41447 #217 (73 connections now open) 2015-06-13T01:39:38.505+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41449 #218 (74 connections now open) 2015-06-13T01:39:38.506+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41450 #219 (75 connections now open) 2015-06-13T01:39:38.506+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41451 #220 (76 connections now open) 2015-06-13T01:39:38.508+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41452 #221 (77 connections now open) 2015-06-13T01:39:38.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41453 #222 (78 connections now open) 2015-06-13T01:39:38.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41455 #223 (79 connections now open) 2015-06-13T01:39:38.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41454 #224 (80 connections now open) 2015-06-13T01:39:38.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41456 #225 (81 connections now open) 2015-06-13T01:39:38.510+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41459 #226 (82 connections now open) 2015-06-13T01:39:38.510+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41457 #227 (83 connections now open) 2015-06-13T01:39:38.510+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41458 #228 (84 connections now open) 2015-06-13T01:39:38.510+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41460 #229 (85 connections now open) 2015-06-13T01:39:38.512+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41461 #230 (86 connections now open) 2015-06-13T01:39:38.515+0000 I SHARDING [conn230] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9152914018267782020 } 2015-06-13T01:39:38.527+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41462 #231 (87 connections now open) 2015-06-13T01:39:38.527+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41463 #232 (88 connections now open) 2015-06-13T01:39:38.528+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41464 #233 (89 connections now open) 2015-06-13T01:39:38.541+0000 I SHARDING [conn200] received splitChunk request: { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } 2015-06-13T01:39:38.552+0000 W SHARDING [conn192] Finding the split vector for ycsb.usertable over { _id: "hashed" } keyCount: 28752 numSplits: 2 lookedAt: 19331 took 111ms 2015-06-13T01:39:38.552+0000 I COMMAND [conn192] command admin.$cmd command: splitVector { splitVector: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, maxChunkSizeBytes: 67108864, maxSplitPoints: 0, maxChunkObjects: 250000 } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:600 reslen:171 locks:{ Global: { acquireCount: { r: 1202 } }, Database: { acquireCount: { r: 601 } }, Collection: { acquireCount: { r: 601 } } } 111ms 2015-06-13T01:39:38.554+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41465 #234 (90 connections now open) 2015-06-13T01:39:38.554+0000 I SHARDING [conn192] received splitChunk request: { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } 2015-06-13T01:39:38.555+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41466 #235 (91 connections now open) 2015-06-13T01:39:38.557+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41467 #236 (92 connections now open) 2015-06-13T01:39:38.561+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41468 #237 (93 connections now open) 2015-06-13T01:39:38.593+0000 I SHARDING [LockPinger] creating distributed lock ping thread for 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 and process ip-10-3-1-101:27017:1434159578:1206341455 (sleeping for 30000ms) 2015-06-13T01:39:38.606+0000 W SHARDING [conn201] Finding the split vector for ycsb.usertable over { _id: "hashed" } keyCount: 28752 numSplits: 2 lookedAt: 19331 took 110ms 2015-06-13T01:39:38.606+0000 I COMMAND [conn201] command admin.$cmd command: splitVector { splitVector: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, maxChunkSizeBytes: 67108864, maxSplitPoints: 0, maxChunkObjects: 250000 } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:600 reslen:171 locks:{ Global: { acquireCount: { r: 1202 } }, Database: { acquireCount: { r: 601 } }, Collection: { acquireCount: { r: 601 } } } 110ms 2015-06-13T01:39:38.607+0000 I SHARDING [conn201] received splitChunk request: { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } 2015-06-13T01:39:38.607+0000 I NETWORK [conn201] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.607+0000 I NETWORK [conn201] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.619+0000 I NETWORK [conn201] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.619+0000 W SHARDING [conn215] Finding the split vector for ycsb.usertable over { _id: "hashed" } keyCount: 28752 numSplits: 2 lookedAt: 19331 took 116ms 2015-06-13T01:39:38.620+0000 I COMMAND [conn215] command admin.$cmd command: splitVector { splitVector: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, maxChunkSizeBytes: 67108864, maxSplitPoints: 0, maxChunkObjects: 250000 } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:600 reslen:171 locks:{ Global: { acquireCount: { r: 1202 } }, Database: { acquireCount: { r: 601 } }, Collection: { acquireCount: { r: 601 } } } 116ms 2015-06-13T01:39:38.620+0000 I SHARDING [conn215] received splitChunk request: { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } 2015-06-13T01:39:38.620+0000 I NETWORK [conn215] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.623+0000 W SHARDING [conn230] Finding the split vector for ycsb.usertable over { _id: "hashed" } keyCount: 28752 numSplits: 2 lookedAt: 19331 took 108ms 2015-06-13T01:39:38.623+0000 I COMMAND [conn230] command admin.$cmd command: splitVector { splitVector: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, maxChunkSizeBytes: 67108864, maxSplitPoints: 0, maxChunkObjects: 250000 } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:600 reslen:171 locks:{ Global: { acquireCount: { r: 1202 } }, Database: { acquireCount: { r: 601 } }, Collection: { acquireCount: { r: 601 } } } 108ms 2015-06-13T01:39:38.624+0000 I SHARDING [conn230] received splitChunk request: { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } 2015-06-13T01:39:38.624+0000 I NETWORK [conn230] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:38.627+0000 I NETWORK [conn230] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.627+0000 I NETWORK [conn230] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.629+0000 I NETWORK [conn215] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:38.629+0000 I NETWORK [conn215] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:38.705+0000 I SHARDING [conn200] could not acquire lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' (another update won) 2015-06-13T01:39:38.705+0000 I SHARDING [conn200] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' was not acquired. 2015-06-13T01:39:38.705+0000 W SHARDING [conn200] could not acquire collection lock for ycsb.usertable to split chunk [{ : MinKey },{ : MaxKey }) :: caused by :: Lock for splitting chunk [{ : MinKey }, { : MaxKey }) in ycsb.usertable is taken. 2015-06-13T01:39:38.705+0000 I COMMAND [conn200] command admin.$cmd command: splitChunk { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:313 locks:{} 165ms 2015-06-13T01:39:38.739+0000 I SHARDING [conn230] could not acquire lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' (another update won) 2015-06-13T01:39:38.739+0000 I SHARDING [conn201] could not acquire lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' (another update won) 2015-06-13T01:39:38.739+0000 I SHARDING [conn230] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' was not acquired. 2015-06-13T01:39:38.739+0000 I SHARDING [conn215] could not acquire lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' (another update won) 2015-06-13T01:39:38.739+0000 W SHARDING [conn230] could not acquire collection lock for ycsb.usertable to split chunk [{ : MinKey },{ : MaxKey }) :: caused by :: Lock for splitting chunk [{ : MinKey }, { : MaxKey }) in ycsb.usertable is taken. 2015-06-13T01:39:38.739+0000 I SHARDING [conn201] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' was not acquired. 2015-06-13T01:39:38.739+0000 I SHARDING [conn215] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' was not acquired. 2015-06-13T01:39:38.739+0000 I COMMAND [conn230] command admin.$cmd command: splitChunk { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:313 locks:{} 115ms 2015-06-13T01:39:38.739+0000 W SHARDING [conn201] could not acquire collection lock for ycsb.usertable to split chunk [{ : MinKey },{ : MaxKey }) :: caused by :: Lock for splitting chunk [{ : MinKey }, { : MaxKey }) in ycsb.usertable is taken. 2015-06-13T01:39:38.739+0000 W SHARDING [conn215] could not acquire collection lock for ycsb.usertable to split chunk [{ : MinKey },{ : MaxKey }) :: caused by :: Lock for splitting chunk [{ : MinKey }, { : MaxKey }) in ycsb.usertable is taken. 2015-06-13T01:39:38.739+0000 I COMMAND [conn215] command admin.$cmd command: splitChunk { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:313 locks:{} 119ms 2015-06-13T01:39:38.739+0000 I COMMAND [conn201] command admin.$cmd command: splitChunk { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:313 locks:{} 132ms 2015-06-13T01:39:38.844+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:39:38.594+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:39:38.844+0000 I SHARDING [conn192] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' acquired, ts : 557b89dace4cc57d12bb9e8a 2015-06-13T01:39:38.844+0000 I SHARDING [conn192] remotely refreshing metadata for ycsb.usertable based on current shard version 2|1039||557b81da73ba23d09dea68fa, current metadata version is 2|1039||557b81da73ba23d09dea68fa 2015-06-13T01:39:38.851+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41469 #238 (94 connections now open) 2015-06-13T01:39:38.852+0000 I SHARDING [conn192] metadata of collection ycsb.usertable already up to date (shard version : 2|1039||557b81da73ba23d09dea68fa, took 2ms) 2015-06-13T01:39:38.852+0000 I SHARDING [conn192] splitChunk accepted at version 2|1039||557b81da73ba23d09dea68fa 2015-06-13T01:39:38.852+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41470 #239 (95 connections now open) 2015-06-13T01:39:38.852+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41471 #240 (96 connections now open) 2015-06-13T01:39:39.110+0000 I REPL [ReplicationExecutor] another primary seen with election time 557b81b1:2 my election time is 557b89d4:1 2015-06-13T01:39:39.110+0000 I REPL [ReplicationExecutor] another PRIMARY detected and it should step down since it was elected earlier than me 2015-06-13T01:39:39.110+0000 I REPL [ReplicationExecutor] Requesting ip-10-3-1-100:27017 step down from primary 2015-06-13T01:39:39.115+0000 I NETWORK [conn192] scoped connection to 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 not being returned to the pool 2015-06-13T01:39:39.116+0000 I SHARDING [conn192] about to log metadata event: { _id: "ip-10-3-1-101-2015-06-13T01:39:39-557b89dbce4cc57d12bb9e8e", server: "ip-10-3-1-101", clientAddr: "10.3.1.99:41423", time: new Date(1434159579116), what: "multi-split", ns: "ycsb.usertable", details: { before: { min: { _id: MinKey }, max: { _id: -9152914018267782020 } }, number: 1, of: 3, chunk: { min: { _id: MinKey }, max: { _id: -9196873246919781244 }, lastmod: Timestamp 2000|1040, lastmodEpoch: ObjectId('557b81da73ba23d09dea68fa') } } } 2015-06-13T01:39:39.282+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41472 #241 (97 connections now open) 2015-06-13T01:39:39.282+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41473 #242 (98 connections now open) 2015-06-13T01:39:39.289+0000 I NETWORK [conn192] scoped connection to 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 not being returned to the pool 2015-06-13T01:39:39.289+0000 I SHARDING [conn192] about to log metadata event: { _id: "ip-10-3-1-101-2015-06-13T01:39:39-557b89dbce4cc57d12bb9e8f", server: "ip-10-3-1-101", clientAddr: "10.3.1.99:41423", time: new Date(1434159579289), what: "multi-split", ns: "ycsb.usertable", details: { before: { min: { _id: MinKey }, max: { _id: -9152914018267782020 } }, number: 2, of: 3, chunk: { min: { _id: -9196873246919781244 }, max: { _id: -9170569416914868370 }, lastmod: Timestamp 2000|1041, lastmodEpoch: ObjectId('557b81da73ba23d09dea68fa') } } } 2015-06-13T01:39:39.459+0000 I NETWORK [conn192] scoped connection to 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 not being returned to the pool 2015-06-13T01:39:39.459+0000 I SHARDING [conn192] about to log metadata event: { _id: "ip-10-3-1-101-2015-06-13T01:39:39-557b89dbce4cc57d12bb9e90", server: "ip-10-3-1-101", clientAddr: "10.3.1.99:41423", time: new Date(1434159579459), what: "multi-split", ns: "ycsb.usertable", details: { before: { min: { _id: MinKey }, max: { _id: -9152914018267782020 } }, number: 3, of: 3, chunk: { min: { _id: -9170569416914868370 }, max: { _id: -9152914018267782020 }, lastmod: Timestamp 2000|1042, lastmodEpoch: ObjectId('557b81da73ba23d09dea68fa') } } } 2015-06-13T01:39:39.494+0000 I NETWORK [conn192] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:39:39.495+0000 I NETWORK [conn192] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:39:39.498+0000 I NETWORK [conn192] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:39:39.632+0000 I SHARDING [conn192] distributed lock 'ycsb.usertable/ip-10-3-1-101:27017:1434159578:1206341455' unlocked. 2015-06-13T01:39:39.632+0000 I COMMAND [conn192] command admin.$cmd command: splitChunk { splitChunk: "ycsb.usertable", keyPattern: { _id: "hashed" }, min: { _id: MinKey }, max: { _id: -9152914018267782020 }, from: "rs0", splitKeys: [ { _id: -9196873246919781244 }, { _id: -9170569416914868370 } ], configdb: "10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019", epoch: ObjectId('557b81da73ba23d09dea68fa') } ntoreturn:1 ntoskip:0 keyUpdates:0 writeConflicts:0 numYields:0 reslen:97 locks:{ Global: { acquireCount: { r: 4, w: 2 } }, Database: { acquireCount: { r: 1, w: 2 } }, Collection: { acquireCount: { r: 1, W: 2 }, acquireWaitCount: { W: 2 }, timeAcquiringMicros: { W: 5597 } } } 1077ms 2015-06-13T01:39:39.669+0000 I SHARDING [conn192] request split points lookup for chunk ycsb.usertable { : MinKey } -->> { : -9196873246919781244 } 2015-06-13T01:39:40.262+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state SECONDARY 2015-06-13T01:39:40.262+0000 I REPL [ReplicationExecutor] Stepping down self (priority 0.5) because ip-10-3-1-100:27017 has higher priority 1 and is only 2 seconds behind me 2015-06-13T01:39:40.262+0000 I REPL [ReplicationExecutor] Stepping down from primary in response to heartbeat 2015-06-13T01:39:40.262+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58588 #243 (99 connections now open) 2015-06-13T01:39:40.267+0000 I REPL [replExecDBWorker-2] transition to SECONDARY 2015-06-13T01:39:40.267+0000 I COMMAND [conn220] assertion while executing command 'update' on database 'ycsb' with arguments '{ update: "usertable", updates: [ { q: { _id: "user1811314573899337876" }, u: { $set: { field1: BinData(0, 233D3A2C2C22342E2E3F3738253A3423222E272A3C353D222B35202B2D303320222D2122223E3A322F3E34293A3F2A34382E202D3A252E223B382E2A373B21253B3D26232D2F...) } } } ], ordered: true, metadata: { shardName: "rs0", shardVersion: [ Timestamp 2000|1042, ObjectId('557b81da73ba23d09dea68fa') ], session: 0 } }' and metadata '{}': 10107 not master 2015-06-13T01:39:40.267+0000 I NETWORK [conn10] end connection 10.3.1.99:41105 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn49] end connection 127.0.0.1:46808 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn185] end connection 10.3.1.99:41412 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn196] end connection 10.3.1.99:41427 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn209] end connection 10.3.1.99:41440 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn203] end connection 10.3.1.99:41434 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn194] end connection 10.3.1.99:41425 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn178] end connection 10.3.1.99:41397 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn186] end connection 10.3.1.99:41414 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn187] end connection 10.3.1.99:41418 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn192] end connection 10.3.1.99:41423 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn189] end connection 10.3.1.99:41420 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn199] end connection 10.3.1.99:41430 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn207] end connection 10.3.1.99:41437 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn182] end connection 10.3.1.99:41409 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn191] end connection 10.3.1.99:41422 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn190] end connection 10.3.1.99:41421 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn183] end connection 10.3.1.99:41411 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn200] end connection 10.3.1.99:41431 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn208] end connection 10.3.1.99:41439 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn202] end connection 10.3.1.99:41433 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn195] end connection 10.3.1.99:41426 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn173] end connection 10.3.1.99:41392 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn171] end connection 10.3.1.99:41390 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn201] end connection 10.3.1.99:41432 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn240] end connection 10.3.1.99:41471 (98 connections now open) 2015-06-13T01:39:40.267+0000 I COMMAND [conn153] assertion while executing command 'update' on database 'ycsb' with arguments '{ update: "usertable", updates: [ { q: { _id: "user5436682470681380675" }, u: { $set: { field2: BinData(0, 2F313B343936333A3C2C31343F353A20293E3924232631352C3B223C373827393B3E283A39293B233020332F3726283A2437233F383A3D3D213734312025323B342738363125...) } } } ], ordered: true, metadata: { shardName: "rs0", shardVersion: [ Timestamp 2000|1042, ObjectId('557b81da73ba23d09dea68fa') ], session: 0 } }' and metadata '{}': 10107 not master 2015-06-13T01:39:40.268+0000 I NETWORK [conn231] end connection 10.3.1.99:41462 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn197] end connection 10.3.1.99:41428 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn239] end connection 10.3.1.99:41470 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn233] end connection 10.3.1.99:41464 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn237] end connection 10.3.1.99:41468 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn212] end connection 10.3.1.99:41443 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn120] end connection 127.0.0.1:46879 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn232] end connection 10.3.1.99:41463 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn214] end connection 10.3.1.99:41445 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn223] end connection 10.3.1.99:41455 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn242] end connection 10.3.1.99:41473 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn220] end connection 10.3.1.99:41451 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn160] end connection 10.3.1.99:41379 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn206] end connection 10.3.1.99:41438 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn162] end connection 10.3.1.99:41382 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn205] end connection 10.3.1.99:41436 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn152] end connection 10.3.1.99:41371 (96 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn213] end connection 10.3.1.99:41444 (94 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn151] end connection 10.3.1.99:41370 (92 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn172] end connection 10.3.1.99:41391 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn170] end connection 10.3.1.99:41389 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn236] end connection 10.3.1.99:41467 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn229] end connection 10.3.1.99:41460 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn175] end connection 10.3.1.99:41394 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn215] end connection 10.3.1.99:41446 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn218] end connection 10.3.1.99:41449 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn228] end connection 10.3.1.99:41458 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn225] end connection 10.3.1.99:41456 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn241] end connection 10.3.1.99:41472 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn184] end connection 10.3.1.99:41410 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn243] end connection 10.3.1.100:58588 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn224] end connection 10.3.1.99:41454 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn234] end connection 10.3.1.99:41465 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn210] end connection 10.3.1.99:41441 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn221] end connection 10.3.1.99:41452 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn180] end connection 10.3.1.99:41403 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn227] end connection 10.3.1.99:41457 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn193] end connection 10.3.1.99:41424 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn156] end connection 10.3.1.99:41376 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn155] end connection 10.3.1.99:41374 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn11] end connection 10.3.1.103:53710 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn204] end connection 10.3.1.99:41435 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn166] end connection 10.3.1.99:41385 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn157] end connection 10.3.1.99:41375 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn174] end connection 10.3.1.99:41393 (98 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn153] end connection 10.3.1.99:41372 (98 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn216] end connection 10.3.1.99:41448 (27 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn161] end connection 10.3.1.99:41380 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn177] end connection 10.3.1.99:41395 (98 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn179] end connection 10.3.1.99:41398 (98 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn217] end connection 10.3.1.99:41447 (24 connections now open) 2015-06-13T01:39:40.267+0000 I NETWORK [conn169] end connection 10.3.1.99:41388 (98 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn219] end connection 10.3.1.99:41450 (21 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn165] end connection 10.3.1.99:41386 (97 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn167] end connection 10.3.1.99:41384 (21 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn154] end connection 10.3.1.99:41373 (21 connections now open) 2015-06-13T01:39:40.268+0000 I NETWORK [conn176] end connection 10.3.1.99:41396 (88 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn164] end connection 10.3.1.99:41381 (16 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn158] end connection 10.3.1.99:41378 (14 connections now open) 2015-06-13T01:39:40.270+0000 I NETWORK [conn198] end connection 10.3.1.99:41429 (18 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [conn230] end connection 10.3.1.99:41461 (13 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [conn211] end connection 10.3.1.99:41442 (11 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41475 #244 (12 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [conn222] end connection 10.3.1.99:41453 (11 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [conn159] end connection 10.3.1.99:41377 (11 connections now open) 2015-06-13T01:39:40.271+0000 I NETWORK [conn181] end connection 10.3.1.99:41405 (11 connections now open) 2015-06-13T01:39:40.271+0000 I QUERY [conn188] assertion 13435 not master and slaveOk=false ns:ycsb.usertable query:{ $query: { _id: "user229129101847577127" } } 2015-06-13T01:39:40.271+0000 I QUERY [conn188] ntoskip:0 ntoreturn:-1 2015-06-13T01:39:40.271+0000 I NETWORK [conn235] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.99:41466] 2015-06-13T01:39:40.271+0000 I NETWORK [conn188] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.99:41419] 2015-06-13T01:39:40.271+0000 I QUERY [conn163] assertion 13435 not master and slaveOk=false ns:ycsb.usertable query:{ $query: { _id: "user9000013227837155416" } } 2015-06-13T01:39:40.271+0000 I QUERY [conn163] ntoskip:0 ntoreturn:-1 2015-06-13T01:39:40.272+0000 I QUERY [conn168] assertion 13435 not master and slaveOk=false ns:ycsb.usertable query:{ $query: { _id: "user2343583784450884475" } } 2015-06-13T01:39:40.272+0000 I QUERY [conn238] assertion 13435 not master and slaveOk=false ns:ycsb.usertable query:{ $query: { _id: "user2208246486407079775" } } 2015-06-13T01:39:40.272+0000 I QUERY [conn168] ntoskip:0 ntoreturn:-1 2015-06-13T01:39:40.272+0000 I NETWORK [conn163] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.99:41383] 2015-06-13T01:39:40.272+0000 I QUERY [conn238] ntoskip:0 ntoreturn:-1 2015-06-13T01:39:40.272+0000 I NETWORK [conn168] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.99:41387] 2015-06-13T01:39:40.272+0000 I NETWORK [conn238] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.99:41469] 2015-06-13T01:39:40.272+0000 I NETWORK [conn226] end connection 10.3.1.99:41459 (6 connections now open) 2015-06-13T01:39:40.506+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33968 #245 (4 connections now open) 2015-06-13T01:39:40.593+0000 I NETWORK [rsBackgroundSync] Socket flush send() errno:9 Bad file descriptor 10.3.1.100:27017 2015-06-13T01:39:40.593+0000 I - [rsBackgroundSync] caught exception (socket exception [SEND_ERROR] for 10.3.1.100:27017) in destructor (~PiggyBackData) 2015-06-13T01:39:41.026+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58589 #246 (5 connections now open) 2015-06-13T01:39:41.027+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58590 #247 (6 connections now open) 2015-06-13T01:39:41.111+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state ROLLBACK 2015-06-13T01:39:41.264+0000 I QUERY [conn246] getmore local.oplog.rs cursorid:22042433971 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:1170 nreturned:149796 reslen:4194308 locks:{ Global: { acquireCount: { r: 2342 } }, Database: { acquireCount: { r: 1171 } }, oplog: { acquireCount: { r: 1171 } } } 234ms 2015-06-13T01:39:41.264+0000 I QUERY [conn245] getmore local.oplog.rs cursorid:21961953285 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:1170 nreturned:149796 reslen:4194308 locks:{ Global: { acquireCount: { r: 2342 } }, Database: { acquireCount: { r: 1171 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 77 } }, oplog: { acquireCount: { r: 1171 } } } 752ms 2015-06-13T01:39:41.435+0000 I NETWORK [conn245] end connection 10.3.1.102:33968 (5 connections now open) 2015-06-13T01:39:41.435+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33969 #248 (6 connections now open) 2015-06-13T01:39:41.788+0000 I NETWORK [conn248] end connection 10.3.1.102:33969 (5 connections now open) 2015-06-13T01:39:41.788+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33970 #249 (6 connections now open) 2015-06-13T01:39:41.834+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.103:55398 #250 (7 connections now open) 2015-06-13T01:39:42.006+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33971 #251 (8 connections now open) 2015-06-13T01:39:42.262+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state ROLLBACK 2015-06-13T01:39:43.111+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state SECONDARY 2015-06-13T01:39:50.355+0000 I NETWORK [conn247] end connection 10.3.1.100:58590 (7 connections now open) 2015-06-13T01:39:50.355+0000 I NETWORK [conn246] end connection 10.3.1.100:58589 (6 connections now open) 2015-06-13T01:39:50.356+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58594 #252 (7 connections now open) 2015-06-13T01:39:50.365+0000 I NETWORK [conn252] end connection 10.3.1.100:58594 (6 connections now open) 2015-06-13T01:39:50.365+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58595 #253 (7 connections now open) 2015-06-13T01:39:50.855+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58596 #254 (8 connections now open) 2015-06-13T01:39:52.262+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state SECONDARY 2015-06-13T01:39:52.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58597 #255 (9 connections now open) 2015-06-13T01:39:52.264+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 19 secs ago 2015-06-13T01:39:52.399+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 19 secs ago 2015-06-13T01:39:52.883+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 20 secs ago 2015-06-13T01:39:53.044+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 20 secs ago 2015-06-13T01:39:53.620+0000 I NETWORK [conn150] end connection 10.3.1.102:33965 (8 connections now open) 2015-06-13T01:39:53.621+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33972 #256 (9 connections now open) 2015-06-13T01:39:53.720+0000 I NETWORK [conn149] end connection 10.3.1.100:58587 (8 connections now open) 2015-06-13T01:39:53.721+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 21 secs ago 2015-06-13T01:39:53.888+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 21 secs ago 2015-06-13T01:39:54.589+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 21 secs ago 2015-06-13T01:39:55.355+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 22 secs ago 2015-06-13T01:39:55.579+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 22 secs ago 2015-06-13T01:39:56.333+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 23 secs ago 2015-06-13T01:39:57.062+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 24 secs ago 2015-06-13T01:39:57.517+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 24 secs ago 2015-06-13T01:39:58.002+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T01:39:58.376+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T01:39:58.517+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T01:39:58.609+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T01:39:58.823+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 26 secs ago 2015-06-13T01:39:59.858+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 27 secs ago 2015-06-13T01:40:00.557+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 27 secs ago 2015-06-13T01:40:00.760+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 28 secs ago 2015-06-13T01:40:01.343+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 28 secs ago 2015-06-13T01:40:02.265+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 29 secs ago 2015-06-13T01:40:02.467+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 29 secs ago 2015-06-13T01:40:03.351+0000 I REPL [ReplicationExecutor] replSetElect voting yea for ip-10-3-1-100:27017 (0) 2015-06-13T01:40:04.263+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state PRIMARY 2015-06-13T01:40:06.598+0000 I REPL [ReplicationExecutor] syncing from: ip-10-3-1-100:27017 2015-06-13T01:40:07.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to ip-10-3-1-100:27017 2015-06-13T01:40:08.844+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:40:11.593+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:40:11.594+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:40:11.854+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:40:11.595+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:40:12.822+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:40 nreturned:5001 reslen:1264405 locks:{ Global: { acquireCount: { r: 82 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 542011 } }, Database: { acquireCount: { r: 41 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 37990 } }, oplog: { acquireCount: { r: 41 } } } 338ms 2015-06-13T01:40:13.160+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528877 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 319267 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 303 } }, oplog: { acquireCount: { r: 79 } } } 173ms 2015-06-13T01:40:13.451+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528870 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 265972 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 465 } }, oplog: { acquireCount: { r: 79 } } } 118ms 2015-06-13T01:40:22.270+0000 I NETWORK [conn255] end connection 10.3.1.100:58597 (7 connections now open) 2015-06-13T01:40:22.271+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58608 #257 (8 connections now open) 2015-06-13T01:40:23.632+0000 I NETWORK [conn256] end connection 10.3.1.102:33972 (7 connections now open) 2015-06-13T01:40:23.633+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33974 #258 (8 connections now open) 2015-06-13T01:40:42.101+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:40:41.855+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:40:48.675+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:29 nreturned:3736 reslen:944608 locks:{ Global: { acquireCount: { r: 60 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 464527 } }, Database: { acquireCount: { r: 30 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 235 } }, oplog: { acquireCount: { r: 30 } } } 181ms 2015-06-13T01:40:49.154+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:25 nreturned:3214 reslen:812619 locks:{ Global: { acquireCount: { r: 52 }, acquireWaitCount: { r: 10 }, timeAcquiringMicros: { r: 244452 } }, Database: { acquireCount: { r: 26 }, acquireWaitCount: { r: 9 }, timeAcquiringMicros: { r: 214106 } }, oplog: { acquireCount: { r: 26 } } } 330ms 2015-06-13T01:40:52.281+0000 I NETWORK [conn257] end connection 10.3.1.100:58608 (7 connections now open) 2015-06-13T01:40:52.281+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58610 #259 (8 connections now open) 2015-06-13T01:40:53.644+0000 I NETWORK [conn258] end connection 10.3.1.102:33974 (7 connections now open) 2015-06-13T01:40:53.645+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33976 #260 (8 connections now open) 2015-06-13T01:41:12.383+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:41:12.102+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:41:22.295+0000 I NETWORK [conn259] end connection 10.3.1.100:58610 (7 connections now open) 2015-06-13T01:41:22.295+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58612 #261 (8 connections now open) 2015-06-13T01:41:23.658+0000 I NETWORK [conn260] end connection 10.3.1.102:33976 (7 connections now open) 2015-06-13T01:41:23.658+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33978 #262 (8 connections now open) 2015-06-13T01:41:40.724+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:19 nreturned:2530 reslen:639669 locks:{ Global: { acquireCount: { r: 42 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 255359 } }, Database: { acquireCount: { r: 21 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 13984597 } }, oplog: { acquireCount: { r: 21 } } } 1260ms 2015-06-13T01:41:42.559+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:41:42.383+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:41:46.056+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264480 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 372321 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 168 } }, oplog: { acquireCount: { r: 40 } } } 185ms 2015-06-13T01:41:46.436+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528812 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 362999 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 203 } }, oplog: { acquireCount: { r: 79 } } } 198ms 2015-06-13T01:41:46.911+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528895 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 344580 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 75839 } }, oplog: { acquireCount: { r: 79 } } } 303ms 2015-06-13T01:41:48.618+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528859 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 2435540 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 225730 } }, oplog: { acquireCount: { r: 79 } } } 1189ms 2015-06-13T01:41:49.732+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194434 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 14 }, timeAcquiringMicros: { r: 941663 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 14 }, timeAcquiringMicros: { r: 104743 } }, oplog: { acquireCount: { r: 130 } } } 945ms 2015-06-13T01:41:50.013+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194312 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 58 }, timeAcquiringMicros: { r: 75336 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 57 }, timeAcquiringMicros: { r: 7762 } }, oplog: { acquireCount: { r: 130 } } } 202ms 2015-06-13T01:41:52.306+0000 I NETWORK [conn261] end connection 10.3.1.100:58612 (7 connections now open) 2015-06-13T01:41:52.307+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58614 #263 (8 connections now open) 2015-06-13T01:41:53.672+0000 I NETWORK [conn262] end connection 10.3.1.102:33978 (7 connections now open) 2015-06-13T01:41:53.673+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33980 #264 (8 connections now open) 2015-06-13T01:42:15.335+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:42:15.139+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:42:22.320+0000 I NETWORK [conn263] end connection 10.3.1.100:58614 (7 connections now open) 2015-06-13T01:42:22.321+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58616 #265 (8 connections now open) 2015-06-13T01:42:23.680+0000 I NETWORK [conn264] end connection 10.3.1.102:33980 (7 connections now open) 2015-06-13T01:42:23.680+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33982 #266 (8 connections now open) 2015-06-13T01:42:45.627+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:42:45.336+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:42:52.329+0000 I NETWORK [conn265] end connection 10.3.1.100:58616 (7 connections now open) 2015-06-13T01:42:52.330+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58656 #267 (8 connections now open) 2015-06-13T01:42:52.358+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:5 reslen:1285 locks:{ Global: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 266 } }, Database: { acquireCount: { r: 1 } }, oplog: { acquireCount: { r: 1 } } } 356ms 2015-06-13T01:42:53.689+0000 I NETWORK [conn266] end connection 10.3.1.102:33982 (7 connections now open) 2015-06-13T01:42:53.690+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33984 #268 (8 connections now open) 2015-06-13T01:42:57.057+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:7 nreturned:896 reslen:226549 locks:{ Global: { acquireCount: { r: 16 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 1400776 } }, Database: { acquireCount: { r: 8 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 153 } }, oplog: { acquireCount: { r: 8 } } } 831ms 2015-06-13T01:42:59.111+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:35 nreturned:4516 reslen:1141860 locks:{ Global: { acquireCount: { r: 74 } }, Database: { acquireCount: { r: 37 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 1407501 } }, oplog: { acquireCount: { r: 37 } } } 1265ms 2015-06-13T01:43:01.561+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:29 nreturned:3743 reslen:946376 locks:{ Global: { acquireCount: { r: 60 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 874492 } }, Database: { acquireCount: { r: 30 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 2555544 } }, oplog: { acquireCount: { r: 30 } } } 2169ms 2015-06-13T01:43:10.873+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:53 nreturned:6836 reslen:1728350 locks:{ Global: { acquireCount: { r: 108 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 3540667 } }, Database: { acquireCount: { r: 54 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 37749124 } }, oplog: { acquireCount: { r: 54 } } } 7311ms 2015-06-13T01:43:15.848+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:43:15.627+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:43:22.344+0000 I NETWORK [conn267] end connection 10.3.1.100:58656 (7 connections now open) 2015-06-13T01:43:22.344+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58670 #269 (9 connections now open) 2015-06-13T01:43:23.703+0000 I NETWORK [conn268] end connection 10.3.1.102:33984 (7 connections now open) 2015-06-13T01:43:25.515+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33986 #270 (8 connections now open) 2015-06-13T01:43:30.628+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194310 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 87159705 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 56448854 } }, oplog: { acquireCount: { r: 130 } } } 18841ms 2015-06-13T01:43:46.025+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:43:45.848+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:43:53.527+0000 I NETWORK [conn269] end connection 10.3.1.100:58670 (7 connections now open) 2015-06-13T01:43:53.528+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58672 #271 (8 connections now open) 2015-06-13T01:43:55.528+0000 I NETWORK [conn270] end connection 10.3.1.102:33986 (7 connections now open) 2015-06-13T01:43:55.529+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33988 #272 (8 connections now open) 2015-06-13T01:44:07.556+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:19 nreturned:2527 reslen:638946 locks:{ Global: { acquireCount: { r: 40 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 170799 } }, Database: { acquireCount: { r: 20 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 1126 } }, oplog: { acquireCount: { r: 20 } } } 152ms 2015-06-13T01:44:16.279+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:44:16.026+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:44:23.550+0000 I NETWORK [conn271] end connection 10.3.1.100:58672 (7 connections now open) 2015-06-13T01:44:23.550+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58702 #273 (8 connections now open) 2015-06-13T01:44:25.543+0000 I NETWORK [conn272] end connection 10.3.1.102:33988 (7 connections now open) 2015-06-13T01:44:25.543+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33990 #274 (8 connections now open) 2015-06-13T01:44:40.678+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:23 nreturned:2977 reslen:752708 locks:{ Global: { acquireCount: { r: 48 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 333131 } }, Database: { acquireCount: { r: 24 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 582 } }, oplog: { acquireCount: { r: 24 } } } 176ms 2015-06-13T01:44:43.212+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:18 nreturned:2412 reslen:609833 locks:{ Global: { acquireCount: { r: 38 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 345879 } }, Database: { acquireCount: { r: 19 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 7160998 } }, oplog: { acquireCount: { r: 19 } } } 2460ms 2015-06-13T01:44:45.165+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:48 nreturned:6207 reslen:1569362 locks:{ Global: { acquireCount: { r: 98 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 2008204 } }, Database: { acquireCount: { r: 49 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 400893 } }, oplog: { acquireCount: { r: 49 } } } 1949ms 2015-06-13T01:44:46.490+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:44:46.279+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:44:53.564+0000 I NETWORK [conn273] end connection 10.3.1.100:58702 (7 connections now open) 2015-06-13T01:44:53.574+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58704 #275 (8 connections now open) 2015-06-13T01:44:55.555+0000 I NETWORK [conn274] end connection 10.3.1.102:33990 (7 connections now open) 2015-06-13T01:44:55.555+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33993 #276 (8 connections now open) 2015-06-13T01:45:13.551+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194310 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 29 }, timeAcquiringMicros: { r: 224048429 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 30 }, timeAcquiringMicros: { r: 43755218 } }, oplog: { acquireCount: { r: 130 } } } 28296ms 2015-06-13T01:45:15.633+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:79 nreturned:10146 reslen:2565195 locks:{ Global: { acquireCount: { r: 160 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 2301042 } }, Database: { acquireCount: { r: 80 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 182774 } }, oplog: { acquireCount: { r: 80 } } } 1896ms 2015-06-13T01:45:16.623+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:45:16.490+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:45:23.589+0000 I NETWORK [conn275] end connection 10.3.1.100:58704 (7 connections now open) 2015-06-13T01:45:23.589+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58706 #277 (8 connections now open) 2015-06-13T01:45:25.464+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194518 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 14 }, timeAcquiringMicros: { r: 47434270 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 14 }, timeAcquiringMicros: { r: 2778671 } }, oplog: { acquireCount: { r: 130 } } } 9644ms 2015-06-13T01:45:25.564+0000 I NETWORK [conn276] end connection 10.3.1.102:33993 (7 connections now open) 2015-06-13T01:45:25.569+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33995 #278 (8 connections now open) 2015-06-13T01:45:26.024+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194508 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 357937 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 84194 } }, oplog: { acquireCount: { r: 130 } } } 414ms 2015-06-13T01:45:26.795+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194541 locks:{ Global: { acquireCount: { r: 260 } }, Database: { acquireCount: { r: 130 } }, oplog: { acquireCount: { r: 130 } } } 114ms 2015-06-13T01:45:46.768+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:45:46.623+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:45:53.600+0000 I NETWORK [conn277] end connection 10.3.1.100:58706 (7 connections now open) 2015-06-13T01:45:53.634+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58708 #279 (8 connections now open) 2015-06-13T01:45:55.584+0000 I NETWORK [conn278] end connection 10.3.1.102:33995 (7 connections now open) 2015-06-13T01:45:55.584+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33997 #280 (8 connections now open) 2015-06-13T01:46:16.912+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:46:16.768+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:46:23.654+0000 I NETWORK [conn279] end connection 10.3.1.100:58708 (7 connections now open) 2015-06-13T01:46:23.655+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58710 #281 (8 connections now open) 2015-06-13T01:46:25.594+0000 I NETWORK [conn280] end connection 10.3.1.102:33997 (7 connections now open) 2015-06-13T01:46:25.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:33999 #282 (8 connections now open) 2015-06-13T01:46:30.362+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:8 nreturned:1063 reslen:268797 locks:{ Global: { acquireCount: { r: 18 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 219384 } }, Database: { acquireCount: { r: 9 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 545 } }, oplog: { acquireCount: { r: 9 } } } 180ms 2015-06-13T01:46:31.557+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:11 nreturned:1413 reslen:357283 locks:{ Global: { acquireCount: { r: 24 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 144385 } }, Database: { acquireCount: { r: 12 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 2531483 } }, oplog: { acquireCount: { r: 12 } } } 1166ms 2015-06-13T01:46:34.419+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:21 nreturned:2728 reslen:689737 locks:{ Global: { acquireCount: { r: 44 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 361813 } }, Database: { acquireCount: { r: 22 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 4783807 } }, oplog: { acquireCount: { r: 22 } } } 1837ms 2015-06-13T01:46:34.826+0000 I NETWORK [ReplExecNetThread-4] Socket recv() timeout 10.3.1.102:27017 2015-06-13T01:46:34.826+0000 I NETWORK [ReplExecNetThread-4] SocketException: remote: 10.3.1.102:27017 error: 9001 socket exception [RECV_TIMEOUT] server [10.3.1.102:27017] 2015-06-13T01:46:34.826+0000 I REPL [ReplicationExecutor] Error in heartbeat request to 10.3.1.102:27017; HostUnreachable network error while attempting to run command 'replSetHeartbeat' on host '10.3.1.102:27017' with arguments '{ replSetHeartbeat: "rs0", pv: 1, v: 5, from: "10.3.1.101:27017", fromId: 1, checkEmpty: false }' and metadata '{}' 2015-06-13T01:46:36.795+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264452 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 549942 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 2607619 } }, oplog: { acquireCount: { r: 40 } } } 1305ms 2015-06-13T01:46:36.847+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state SECONDARY 2015-06-13T01:46:47.063+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:46:46.912+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:46:53.666+0000 I NETWORK [conn281] end connection 10.3.1.100:58710 (7 connections now open) 2015-06-13T01:46:53.666+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58713 #283 (8 connections now open) 2015-06-13T01:46:55.608+0000 I NETWORK [conn282] end connection 10.3.1.102:33999 (7 connections now open) 2015-06-13T01:46:55.608+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34001 #284 (9 connections now open) 2015-06-13T01:47:04.204+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:76 nreturned:9840 reslen:2487912 locks:{ Global: { acquireCount: { r: 154 }, acquireWaitCount: { r: 9 }, timeAcquiringMicros: { r: 141551089 } }, Database: { acquireCount: { r: 77 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 104828399 } }, oplog: { acquireCount: { r: 77 } } } 27236ms 2015-06-13T01:47:07.158+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194430 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 13 }, timeAcquiringMicros: { r: 2658793 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 12 }, timeAcquiringMicros: { r: 168678 } }, oplog: { acquireCount: { r: 130 } } } 2815ms 2015-06-13T01:47:14.281+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:130 nreturned:16590 reslen:4194488 locks:{ Global: { acquireCount: { r: 262 }, acquireWaitCount: { r: 16 }, timeAcquiringMicros: { r: 3745308 } }, Database: { acquireCount: { r: 131 }, acquireWaitCount: { r: 15 }, timeAcquiringMicros: { r: 17653186 } }, oplog: { acquireCount: { r: 131 } } } 6938ms 2015-06-13T01:47:14.752+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:23 nreturned:2986 reslen:754981 locks:{ Global: { acquireCount: { r: 48 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 430080 } }, Database: { acquireCount: { r: 24 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 434 } }, oplog: { acquireCount: { r: 24 } } } 349ms 2015-06-13T01:47:16.613+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194291 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 2159503 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 93724 } }, oplog: { acquireCount: { r: 130 } } } 1857ms 2015-06-13T01:47:16.792+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194470 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 12 }, timeAcquiringMicros: { r: 17434 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 12 }, timeAcquiringMicros: { r: 14702 } }, oplog: { acquireCount: { r: 130 } } } 156ms 2015-06-13T01:47:17.247+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:47:17.063+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:47:17.317+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194320 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 21 }, timeAcquiringMicros: { r: 27500 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 20 }, timeAcquiringMicros: { r: 3430 } }, oplog: { acquireCount: { r: 130 } } } 150ms 2015-06-13T01:47:17.545+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194523 locks:{ Global: { acquireCount: { r: 260 } }, Database: { acquireCount: { r: 130 } }, oplog: { acquireCount: { r: 130 } } } 101ms 2015-06-13T01:47:17.670+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194469 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 3745 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 500 } }, oplog: { acquireCount: { r: 130 } } } 109ms 2015-06-13T01:47:17.924+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194483 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 56 }, timeAcquiringMicros: { r: 56952 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 56 }, timeAcquiringMicros: { r: 6902 } }, oplog: { acquireCount: { r: 130 } } } 170ms 2015-06-13T01:47:18.055+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194292 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 39 }, timeAcquiringMicros: { r: 32488 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 39 }, timeAcquiringMicros: { r: 6596 } }, oplog: { acquireCount: { r: 130 } } } 111ms 2015-06-13T01:47:23.679+0000 I NETWORK [conn283] end connection 10.3.1.100:58713 (7 connections now open) 2015-06-13T01:47:23.680+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58715 #285 (8 connections now open) 2015-06-13T01:47:25.863+0000 I NETWORK [conn284] end connection 10.3.1.102:34001 (7 connections now open) 2015-06-13T01:47:25.873+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34003 #286 (8 connections now open) 2015-06-13T01:47:47.504+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:47:47.247+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:47:53.694+0000 I NETWORK [conn285] end connection 10.3.1.100:58715 (7 connections now open) 2015-06-13T01:47:53.694+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58717 #287 (8 connections now open) 2015-06-13T01:47:55.884+0000 I NETWORK [conn286] end connection 10.3.1.102:34003 (7 connections now open) 2015-06-13T01:47:55.885+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34005 #288 (8 connections now open) 2015-06-13T01:48:17.785+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:48:17.504+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:48:20.286+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264435 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 590130 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 212 } }, oplog: { acquireCount: { r: 40 } } } 198ms 2015-06-13T01:48:23.706+0000 I NETWORK [conn287] end connection 10.3.1.100:58717 (7 connections now open) 2015-06-13T01:48:23.706+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58719 #289 (8 connections now open) 2015-06-13T01:48:25.350+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:20 nreturned:2605 reslen:658663 locks:{ Global: { acquireCount: { r: 42 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 1340969 } }, Database: { acquireCount: { r: 21 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 22208582 } }, oplog: { acquireCount: { r: 21 } } } 854ms 2015-06-13T01:48:25.891+0000 I NETWORK [conn288] end connection 10.3.1.102:34005 (7 connections now open) 2015-06-13T01:48:25.894+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34007 #290 (8 connections now open) 2015-06-13T01:48:48.065+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:48:47.785+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:48:49.154+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:90 nreturned:11533 reslen:2915895 locks:{ Global: { acquireCount: { r: 182 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 120635906 } }, Database: { acquireCount: { r: 91 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 45652665 } }, oplog: { acquireCount: { r: 91 } } } 23315ms 2015-06-13T01:48:51.892+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194519 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 13 }, timeAcquiringMicros: { r: 2415695 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 12 }, timeAcquiringMicros: { r: 172889 } }, oplog: { acquireCount: { r: 130 } } } 2567ms 2015-06-13T01:48:52.378+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:104 nreturned:13416 reslen:3391964 locks:{ Global: { acquireCount: { r: 210 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 369629 } }, Database: { acquireCount: { r: 105 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 78001 } }, oplog: { acquireCount: { r: 105 } } } 298ms 2015-06-13T01:48:52.954+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194502 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 541546 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 451 } }, oplog: { acquireCount: { r: 130 } } } 406ms 2015-06-13T01:48:53.717+0000 I NETWORK [conn289] end connection 10.3.1.100:58719 (7 connections now open) 2015-06-13T01:48:53.718+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58721 #291 (9 connections now open) 2015-06-13T01:48:57.054+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34009 #292 (9 connections now open) 2015-06-13T01:48:55.909+0000 I NETWORK [conn290] end connection 10.3.1.102:34007 (7 connections now open) 2015-06-13T01:48:59.664+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194523 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 14 }, timeAcquiringMicros: { r: 24297171 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 13 }, timeAcquiringMicros: { r: 262226 } }, oplog: { acquireCount: { r: 130 } } } 2399ms 2015-06-13T01:49:02.410+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194319 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 13 }, timeAcquiringMicros: { r: 2919934 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 13 }, timeAcquiringMicros: { r: 193404 } }, oplog: { acquireCount: { r: 130 } } } 2641ms 2015-06-13T01:49:04.019+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194485 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 17 }, timeAcquiringMicros: { r: 1897513 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 17 }, timeAcquiringMicros: { r: 53543 } }, oplog: { acquireCount: { r: 130 } } } 1423ms 2015-06-13T01:49:04.298+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194523 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 41 }, timeAcquiringMicros: { r: 41297 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 42 }, timeAcquiringMicros: { r: 5154 } }, oplog: { acquireCount: { r: 130 } } } 152ms 2015-06-13T01:49:04.729+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194497 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 36 }, timeAcquiringMicros: { r: 103938 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 36 }, timeAcquiringMicros: { r: 192325 } }, oplog: { acquireCount: { r: 130 } } } 411ms 2015-06-13T01:49:04.965+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194443 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 55 }, timeAcquiringMicros: { r: 74001 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 55 }, timeAcquiringMicros: { r: 7787 } }, oplog: { acquireCount: { r: 130 } } } 211ms 2015-06-13T01:49:05.196+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194363 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 40 }, timeAcquiringMicros: { r: 73549 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 41 }, timeAcquiringMicros: { r: 6143 } }, oplog: { acquireCount: { r: 130 } } } 210ms 2015-06-13T01:49:05.445+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194486 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 57 }, timeAcquiringMicros: { r: 80653 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 58 }, timeAcquiringMicros: { r: 7748 } }, oplog: { acquireCount: { r: 130 } } } 227ms 2015-06-13T01:49:05.695+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194340 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 59 }, timeAcquiringMicros: { r: 66769 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 59 }, timeAcquiringMicros: { r: 22866 } }, oplog: { acquireCount: { r: 130 } } } 228ms 2015-06-13T01:49:05.877+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194438 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 45 }, timeAcquiringMicros: { r: 52442 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 45 }, timeAcquiringMicros: { r: 5379 } }, oplog: { acquireCount: { r: 130 } } } 162ms 2015-06-13T01:49:06.068+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194400 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 45 }, timeAcquiringMicros: { r: 57546 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 45 }, timeAcquiringMicros: { r: 5270 } }, oplog: { acquireCount: { r: 130 } } } 173ms 2015-06-13T01:49:06.243+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194511 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 50 }, timeAcquiringMicros: { r: 49705 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 51 }, timeAcquiringMicros: { r: 7417 } }, oplog: { acquireCount: { r: 130 } } } 162ms 2015-06-13T01:49:06.491+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194536 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 57 }, timeAcquiringMicros: { r: 74194 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 56 }, timeAcquiringMicros: { r: 9153 } }, oplog: { acquireCount: { r: 130 } } } 231ms 2015-06-13T01:49:06.705+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:121 nreturned:15532 reslen:3927075 locks:{ Global: { acquireCount: { r: 244 }, acquireWaitCount: { r: 53 }, timeAcquiringMicros: { r: 74485 } }, Database: { acquireCount: { r: 122 }, acquireWaitCount: { r: 51 }, timeAcquiringMicros: { r: 18531 } }, oplog: { acquireCount: { r: 122 } } } 199ms 2015-06-13T01:49:06.906+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194505 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 50 }, timeAcquiringMicros: { r: 63096 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 50 }, timeAcquiringMicros: { r: 7724 } }, oplog: { acquireCount: { r: 130 } } } 187ms 2015-06-13T01:49:19.133+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:49:18.855+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:49:25.067+0000 I NETWORK [conn291] end connection 10.3.1.100:58721 (7 connections now open) 2015-06-13T01:49:25.068+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58723 #293 (8 connections now open) 2015-06-13T01:49:27.067+0000 I NETWORK [conn292] end connection 10.3.1.102:34009 (7 connections now open) 2015-06-13T01:49:27.068+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34011 #294 (8 connections now open) 2015-06-13T01:49:49.413+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:49:49.134+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:49:55.079+0000 I NETWORK [conn293] end connection 10.3.1.100:58723 (7 connections now open) 2015-06-13T01:49:55.079+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58725 #295 (8 connections now open) 2015-06-13T01:49:57.079+0000 I NETWORK [conn294] end connection 10.3.1.102:34011 (7 connections now open) 2015-06-13T01:49:57.079+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34013 #296 (8 connections now open) 2015-06-13T01:50:04.748+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:178 reslen:45023 locks:{ Global: { acquireCount: { r: 4 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 20290 } }, Database: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 133905 } }, oplog: { acquireCount: { r: 2 } } } 134ms 2015-06-13T01:50:08.597+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:3 nreturned:480 reslen:121376 locks:{ Global: { acquireCount: { r: 8 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 60866 } }, Database: { acquireCount: { r: 4 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 4761422 } }, oplog: { acquireCount: { r: 4 } } } 1761ms 2015-06-13T01:50:16.474+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264426 locks:{ Global: { acquireCount: { r: 82 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 1055117 } }, Database: { acquireCount: { r: 41 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 20743973 } }, oplog: { acquireCount: { r: 41 } } } 3727ms 2015-06-13T01:50:19.556+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:50:19.414+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:50:20.032+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264447 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2516060 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 10028695 } }, oplog: { acquireCount: { r: 40 } } } 2532ms 2015-06-13T01:50:25.086+0000 I NETWORK [conn295] end connection 10.3.1.100:58725 (7 connections now open) 2015-06-13T01:50:25.088+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58727 #297 (9 connections now open) 2015-06-13T01:50:27.094+0000 I NETWORK [conn296] end connection 10.3.1.102:34013 (7 connections now open) 2015-06-13T01:50:34.616+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34015 #298 (9 connections now open) 2015-06-13T01:50:37.965+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264456 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 338798 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 372 } }, oplog: { acquireCount: { r: 40 } } } 198ms 2015-06-13T01:50:40.222+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264428 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 1629983 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 445 } }, oplog: { acquireCount: { r: 40 } } } 976ms 2015-06-13T01:50:46.374+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528853 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 618296 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 32989415 } }, oplog: { acquireCount: { r: 79 } } } 660ms 2015-06-13T01:50:46.956+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194494 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 471799 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 81815 } }, oplog: { acquireCount: { r: 130 } } } 217ms 2015-06-13T01:50:48.222+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:65 nreturned:8415 reslen:2127580 locks:{ Global: { acquireCount: { r: 132 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 1033884 } }, Database: { acquireCount: { r: 66 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 111151 } }, oplog: { acquireCount: { r: 66 } } } 1119ms 2015-06-13T01:50:49.837+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:50:49.556+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:50:50.509+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194488 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 28 }, timeAcquiringMicros: { r: 2562549 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 28 }, timeAcquiringMicros: { r: 84116 } }, oplog: { acquireCount: { r: 130 } } } 2172ms 2015-06-13T01:50:50.744+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194432 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 52 }, timeAcquiringMicros: { r: 69641 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 53 }, timeAcquiringMicros: { r: 7576 } }, oplog: { acquireCount: { r: 130 } } } 213ms 2015-06-13T01:50:50.941+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:92 nreturned:11829 reslen:2990884 locks:{ Global: { acquireCount: { r: 186 }, acquireWaitCount: { r: 22 }, timeAcquiringMicros: { r: 71644 } }, Database: { acquireCount: { r: 93 }, acquireWaitCount: { r: 22 }, timeAcquiringMicros: { r: 4654 } }, oplog: { acquireCount: { r: 93 } } } 177ms 2015-06-13T01:50:51.133+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194486 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 55 }, timeAcquiringMicros: { r: 60629 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 55 }, timeAcquiringMicros: { r: 5972 } }, oplog: { acquireCount: { r: 130 } } } 179ms 2015-06-13T01:50:56.625+0000 I NETWORK [conn297] end connection 10.3.1.100:58727 (7 connections now open) 2015-06-13T01:50:56.625+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58729 #299 (8 connections now open) 2015-06-13T01:50:58.625+0000 I NETWORK [conn298] end connection 10.3.1.102:34015 (7 connections now open) 2015-06-13T01:50:58.626+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34017 #300 (8 connections now open) 2015-06-13T01:51:16.226+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264376 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 277475 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 446 } }, oplog: { acquireCount: { r: 40 } } } 101ms 2015-06-13T01:51:20.117+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:51:19.837+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:51:26.637+0000 I NETWORK [conn299] end connection 10.3.1.100:58729 (7 connections now open) 2015-06-13T01:51:26.637+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58731 #301 (8 connections now open) 2015-06-13T01:51:28.639+0000 I NETWORK [conn300] end connection 10.3.1.102:34017 (7 connections now open) 2015-06-13T01:51:28.639+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34019 #302 (8 connections now open) 2015-06-13T01:51:50.363+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:51:50.117+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:51:56.651+0000 I NETWORK [conn301] end connection 10.3.1.100:58731 (7 connections now open) 2015-06-13T01:51:56.652+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58733 #303 (8 connections now open) 2015-06-13T01:51:58.648+0000 I NETWORK [conn302] end connection 10.3.1.102:34019 (7 connections now open) 2015-06-13T01:51:58.649+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34021 #304 (8 connections now open) 2015-06-13T01:52:20.646+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:52:20.364+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:52:22.210+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:35 nreturned:4499 reslen:1137503 locks:{ Global: { acquireCount: { r: 74 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 126033893 } }, Database: { acquireCount: { r: 37 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 7076214 } }, oplog: { acquireCount: { r: 37 } } } 11513ms 2015-06-13T01:52:26.663+0000 I NETWORK [conn303] end connection 10.3.1.100:58733 (7 connections now open) 2015-06-13T01:52:26.663+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58735 #305 (8 connections now open) 2015-06-13T01:52:28.420+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:117 nreturned:15003 reslen:3793235 locks:{ Global: { acquireCount: { r: 236 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 289816 } }, Database: { acquireCount: { r: 118 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 466 } }, oplog: { acquireCount: { r: 118 } } } 168ms 2015-06-13T01:52:28.664+0000 I NETWORK [conn304] end connection 10.3.1.102:34021 (7 connections now open) 2015-06-13T01:52:28.665+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34023 #306 (8 connections now open) 2015-06-13T01:52:28.780+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:65 nreturned:8372 reslen:2116780 locks:{ Global: { acquireCount: { r: 132 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 209358 } }, Database: { acquireCount: { r: 66 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 73432 } }, oplog: { acquireCount: { r: 66 } } } 225ms 2015-06-13T01:52:52.256+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:52:52.005+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:52:53.423+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:3 nreturned:384 reslen:97106 locks:{ Global: { acquireCount: { r: 8 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 107303 } }, Database: { acquireCount: { r: 4 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2561596 } }, oplog: { acquireCount: { r: 4 } } } 1122ms 2015-06-13T01:52:56.678+0000 I NETWORK [conn305] end connection 10.3.1.100:58735 (7 connections now open) 2015-06-13T01:52:56.678+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58737 #307 (8 connections now open) 2015-06-13T01:52:56.790+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:18 nreturned:2349 reslen:593930 locks:{ Global: { acquireCount: { r: 38 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 197795 } }, Database: { acquireCount: { r: 19 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 7335514 } }, oplog: { acquireCount: { r: 19 } } } 2335ms 2015-06-13T01:52:57.872+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264435 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 277671 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 195 } }, oplog: { acquireCount: { r: 40 } } } 151ms 2015-06-13T01:52:58.676+0000 I NETWORK [conn306] end connection 10.3.1.102:34023 (7 connections now open) 2015-06-13T01:52:58.677+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34025 #308 (8 connections now open) 2015-06-13T01:53:22.502+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:53:22.256+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:53:26.687+0000 I NETWORK [conn307] end connection 10.3.1.100:58737 (7 connections now open) 2015-06-13T01:53:26.687+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58739 #309 (8 connections now open) 2015-06-13T01:53:28.686+0000 I NETWORK [conn308] end connection 10.3.1.102:34025 (7 connections now open) 2015-06-13T01:53:28.686+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34027 #310 (8 connections now open) 2015-06-13T01:53:30.772+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:143 reslen:36168 locks:{ Global: { acquireCount: { r: 4 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 21732 } }, Database: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2732817 } }, oplog: { acquireCount: { r: 2 } } } 1232ms 2015-06-13T01:53:49.581+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:10 nreturned:1346 reslen:340356 locks:{ Global: { acquireCount: { r: 22 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 376887 } }, Database: { acquireCount: { r: 11 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 1330623 } }, oplog: { acquireCount: { r: 11 } } } 832ms 2015-06-13T01:53:52.748+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:53:52.502+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:53:56.698+0000 I NETWORK [conn309] end connection 10.3.1.100:58739 (7 connections now open) 2015-06-13T01:53:56.698+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58741 #311 (9 connections now open) 2015-06-13T01:53:58.700+0000 I NETWORK [conn310] end connection 10.3.1.102:34027 (7 connections now open) 2015-06-13T01:54:08.832+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34029 #312 (8 connections now open) 2015-06-13T01:54:08.832+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58743 #313 (9 connections now open) 2015-06-13T01:54:08.832+0000 I NETWORK [conn311] end connection 10.3.1.100:58741 (8 connections now open) 2015-06-13T01:54:08.832+0000 I NETWORK [conn312] end connection 10.3.1.102:34029 (8 connections now open) 2015-06-13T01:54:10.708+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34030 #314 (8 connections now open) 2015-06-13T01:54:38.848+0000 I NETWORK [conn313] end connection 10.3.1.100:58743 (7 connections now open) 2015-06-13T01:54:38.848+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58745 #315 (8 connections now open) 2015-06-13T01:54:39.107+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:54:38.832+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:54:40.716+0000 I NETWORK [conn314] end connection 10.3.1.102:34030 (7 connections now open) 2015-06-13T01:54:40.716+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34032 #316 (8 connections now open) 2015-06-13T01:54:46.359+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:27 nreturned:3505 reslen:886199 locks:{ Global: { acquireCount: { r: 56 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 366116 } }, Database: { acquireCount: { r: 28 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 205 } }, oplog: { acquireCount: { r: 28 } } } 143ms 2015-06-13T01:55:08.859+0000 I NETWORK [conn315] end connection 10.3.1.100:58745 (7 connections now open) 2015-06-13T01:55:08.859+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58747 #317 (8 connections now open) 2015-06-13T01:55:09.354+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:55:09.107+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:55:10.727+0000 I NETWORK [conn316] end connection 10.3.1.102:34032 (7 connections now open) 2015-06-13T01:55:10.728+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34034 #318 (8 connections now open) 2015-06-13T01:55:18.078+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:40 nreturned:5154 reslen:1303166 locks:{ Global: { acquireCount: { r: 82 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 329253 } }, Database: { acquireCount: { r: 41 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 4758239 } }, oplog: { acquireCount: { r: 41 } } } 1919ms 2015-06-13T01:55:19.914+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:53 nreturned:6877 reslen:1738758 locks:{ Global: { acquireCount: { r: 108 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 1590424 } }, Database: { acquireCount: { r: 54 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 1218084 } }, oplog: { acquireCount: { r: 54 } } } 1193ms 2015-06-13T01:55:25.752+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264473 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 1113269 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 22218968 } }, oplog: { acquireCount: { r: 40 } } } 4222ms 2015-06-13T01:55:33.394+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264455 locks:{ Global: { acquireCount: { r: 82 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2535296 } }, Database: { acquireCount: { r: 41 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 17976560 } }, oplog: { acquireCount: { r: 41 } } } 2042ms 2015-06-13T01:55:38.870+0000 I NETWORK [conn317] end connection 10.3.1.100:58747 (7 connections now open) 2015-06-13T01:55:38.870+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58749 #319 (9 connections now open) 2015-06-13T01:55:39.599+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:55:39.354+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:55:40.739+0000 I NETWORK [conn318] end connection 10.3.1.102:34034 (7 connections now open) 2015-06-13T01:55:44.225+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34036 #320 (9 connections now open) 2015-06-13T01:55:45.993+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264419 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 11 }, timeAcquiringMicros: { r: 463526 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 9 }, timeAcquiringMicros: { r: 1329 } }, oplog: { acquireCount: { r: 40 } } } 111ms 2015-06-13T01:56:08.951+0000 I NETWORK [conn319] end connection 10.3.1.100:58749 (7 connections now open) 2015-06-13T01:56:08.951+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58751 #321 (8 connections now open) 2015-06-13T01:56:12.235+0000 I NETWORK [conn320] end connection 10.3.1.102:34036 (7 connections now open) 2015-06-13T01:56:12.235+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34038 #322 (8 connections now open) 2015-06-13T01:56:14.485+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:56:14.225+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:56:38.731+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:15 nreturned:1940 reslen:490523 locks:{ Global: { acquireCount: { r: 34 } }, Database: { acquireCount: { r: 17 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2702325 } }, oplog: { acquireCount: { r: 17 } } } 1357ms 2015-06-13T01:56:38.962+0000 I NETWORK [conn321] end connection 10.3.1.100:58751 (7 connections now open) 2015-06-13T01:56:38.962+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58753 #323 (8 connections now open) 2015-06-13T01:56:42.245+0000 I NETWORK [conn322] end connection 10.3.1.102:34038 (7 connections now open) 2015-06-13T01:56:42.245+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34040 #324 (8 connections now open) 2015-06-13T01:56:44.798+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:56:44.485+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:56:49.091+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264477 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 1405763 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 183 } }, oplog: { acquireCount: { r: 40 } } } 635ms 2015-06-13T01:56:49.333+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:16 nreturned:2139 reslen:540839 locks:{ Global: { acquireCount: { r: 34 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 165445 } }, Database: { acquireCount: { r: 17 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 50408 } }, oplog: { acquireCount: { r: 17 } } } 185ms 2015-06-13T01:57:00.211+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:22 nreturned:2896 reslen:732200 locks:{ Global: { acquireCount: { r: 46 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 161409 } }, Database: { acquireCount: { r: 23 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 4651185 } }, oplog: { acquireCount: { r: 23 } } } 164ms 2015-06-13T01:57:02.503+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264424 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 1331509 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2947101 } }, oplog: { acquireCount: { r: 40 } } } 1451ms 2015-06-13T01:57:08.980+0000 I NETWORK [conn323] end connection 10.3.1.100:58753 (7 connections now open) 2015-06-13T01:57:08.984+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58755 #325 (8 connections now open) 2015-06-13T01:57:12.256+0000 I NETWORK [conn324] end connection 10.3.1.102:34040 (7 connections now open) 2015-06-13T01:57:12.256+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34042 #326 (9 connections now open) 2015-06-13T01:57:15.048+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:57:14.798+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:57:23.849+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264400 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2544359 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 217304668 } }, oplog: { acquireCount: { r: 40 } } } 14260ms 2015-06-13T01:57:23.849+0000 I NETWORK [conn326] end connection 10.3.1.102:34042 (7 connections now open) 2015-06-13T01:57:24.257+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34044 #327 (8 connections now open) 2015-06-13T01:57:25.431+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264494 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 344426 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 181 } }, oplog: { acquireCount: { r: 40 } } } 177ms 2015-06-13T01:57:25.625+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264449 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 180967 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 228 } }, oplog: { acquireCount: { r: 40 } } } 188ms 2015-06-13T01:57:26.457+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528895 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 743162 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 68470 } }, oplog: { acquireCount: { r: 79 } } } 435ms 2015-06-13T01:57:27.244+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:117 nreturned:15003 reslen:3793217 locks:{ Global: { acquireCount: { r: 236 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 729668 } }, Database: { acquireCount: { r: 118 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 691 } }, oplog: { acquireCount: { r: 118 } } } 578ms 2015-06-13T01:57:28.147+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194511 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 762043 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 74695 } }, oplog: { acquireCount: { r: 130 } } } 705ms 2015-06-13T01:57:33.704+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194296 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 1253652 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 17970625 } }, oplog: { acquireCount: { r: 130 } } } 5355ms 2015-06-13T01:57:38.997+0000 I NETWORK [conn325] end connection 10.3.1.100:58755 (7 connections now open) 2015-06-13T01:57:38.998+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58757 #328 (8 connections now open) 2015-06-13T01:57:54.068+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:57:53.848+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:57:54.268+0000 I NETWORK [conn327] end connection 10.3.1.102:34044 (7 connections now open) 2015-06-13T01:57:54.268+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34046 #329 (8 connections now open) 2015-06-13T01:58:09.012+0000 I NETWORK [conn328] end connection 10.3.1.100:58757 (7 connections now open) 2015-06-13T01:58:09.012+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58759 #330 (8 connections now open) 2015-06-13T01:58:24.276+0000 I NETWORK [conn329] end connection 10.3.1.102:34046 (7 connections now open) 2015-06-13T01:58:24.276+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34048 #331 (8 connections now open) 2015-06-13T01:58:24.279+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:58:24.068+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:58:37.145+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264453 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 433535 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 215 } }, oplog: { acquireCount: { r: 40 } } } 147ms 2015-06-13T01:58:39.026+0000 I NETWORK [conn330] end connection 10.3.1.100:58759 (7 connections now open) 2015-06-13T01:58:39.026+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58761 #332 (8 connections now open) 2015-06-13T01:58:44.301+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:13 nreturned:1730 reslen:437401 locks:{ Global: { acquireCount: { r: 28 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 177602 } }, Database: { acquireCount: { r: 14 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 2980214 } }, oplog: { acquireCount: { r: 14 } } } 1481ms 2015-06-13T01:58:54.285+0000 I NETWORK [conn331] end connection 10.3.1.102:34048 (7 connections now open) 2015-06-13T01:58:54.285+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34050 #333 (8 connections now open) 2015-06-13T01:58:54.524+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:58:54.279+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:59:04.364+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264374 locks:{ Global: { acquireCount: { r: 82 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 104979643 } }, Database: { acquireCount: { r: 41 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 22145164 } }, oplog: { acquireCount: { r: 41 } } } 10963ms 2015-06-13T01:59:05.601+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264445 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 405964 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 183 } }, oplog: { acquireCount: { r: 40 } } } 240ms 2015-06-13T01:59:05.929+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264470 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 220129 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 95070 } }, oplog: { acquireCount: { r: 40 } } } 226ms 2015-06-13T01:59:06.129+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264439 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 189143 } }, Database: { acquireCount: { r: 40 } }, oplog: { acquireCount: { r: 40 } } } 192ms 2015-06-13T01:59:06.318+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264378 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 180310 } }, Database: { acquireCount: { r: 40 } }, oplog: { acquireCount: { r: 40 } } } 184ms 2015-06-13T01:59:06.542+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264445 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 211737 } }, Database: { acquireCount: { r: 40 } }, oplog: { acquireCount: { r: 40 } } } 218ms 2015-06-13T01:59:07.013+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528884 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 372592 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 57330 } }, oplog: { acquireCount: { r: 79 } } } 278ms 2015-06-13T01:59:07.372+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528853 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 327973 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 186 } }, oplog: { acquireCount: { r: 79 } } } 182ms 2015-06-13T01:59:09.042+0000 I NETWORK [conn332] end connection 10.3.1.100:58761 (7 connections now open) 2015-06-13T01:59:09.043+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58763 #334 (8 connections now open) 2015-06-13T01:59:13.177+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:39 nreturned:5001 reslen:1264433 locks:{ Global: { acquireCount: { r: 80 }, acquireWaitCount: { r: 3 }, timeAcquiringMicros: { r: 22587555 } }, Database: { acquireCount: { r: 40 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 450 } }, oplog: { acquireCount: { r: 40 } } } 4423ms 2015-06-13T01:59:15.060+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:78 nreturned:10002 reslen:2528834 locks:{ Global: { acquireCount: { r: 158 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 1096778 } }, Database: { acquireCount: { r: 79 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 1223376 } }, oplog: { acquireCount: { r: 79 } } } 1236ms 2015-06-13T01:59:18.248+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194289 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 16 }, timeAcquiringMicros: { r: 3301230 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 16 }, timeAcquiringMicros: { r: 231215 } }, oplog: { acquireCount: { r: 130 } } } 3054ms 2015-06-13T01:59:18.423+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194473 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 11 }, timeAcquiringMicros: { r: 17944 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 10 }, timeAcquiringMicros: { r: 1276 } }, oplog: { acquireCount: { r: 130 } } } 141ms 2015-06-13T01:59:18.645+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194462 locks:{ Global: { acquireCount: { r: 260 } }, Database: { acquireCount: { r: 130 } }, oplog: { acquireCount: { r: 130 } } } 139ms 2015-06-13T01:59:18.797+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194541 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 4012 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 6 }, timeAcquiringMicros: { r: 726 } }, oplog: { acquireCount: { r: 130 } } } 134ms 2015-06-13T01:59:19.074+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16590 reslen:4194467 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 60 }, timeAcquiringMicros: { r: 74511 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 60 }, timeAcquiringMicros: { r: 9015 } }, oplog: { acquireCount: { r: 130 } } } 256ms 2015-06-13T01:59:19.367+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:129 nreturned:16589 reslen:4194338 locks:{ Global: { acquireCount: { r: 260 }, acquireWaitCount: { r: 53 }, timeAcquiringMicros: { r: 116330 } }, Database: { acquireCount: { r: 130 }, acquireWaitCount: { r: 53 }, timeAcquiringMicros: { r: 28574 } }, oplog: { acquireCount: { r: 130 } } } 277ms 2015-06-13T01:59:19.488+0000 I QUERY [conn249] getmore local.oplog.rs query: { ts: { $gte: Timestamp 1434159578000|100 } } cursorid:23436541757 ntoreturn:0 keyUpdates:0 writeConflicts:0 numYields:45 nreturned:5783 reslen:1462144 locks:{ Global: { acquireCount: { r: 92 }, acquireWaitCount: { r: 23 }, timeAcquiringMicros: { r: 50428 } }, Database: { acquireCount: { r: 46 }, acquireWaitCount: { r: 24 }, timeAcquiringMicros: { r: 7717 } }, oplog: { acquireCount: { r: 46 } } } 101ms 2015-06-13T01:59:24.297+0000 I NETWORK [conn333] end connection 10.3.1.102:34050 (7 connections now open) 2015-06-13T01:59:24.297+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34052 #335 (8 connections now open) 2015-06-13T01:59:34.398+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T01:59:34.226+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T01:59:39.055+0000 I NETWORK [conn334] end connection 10.3.1.100:58763 (7 connections now open) 2015-06-13T01:59:39.055+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58765 #336 (8 connections now open) 2015-06-13T01:59:53.174+0000 I NETWORK [ReplExecNetThread-4] Socket recv() timeout 10.3.1.100:27017 2015-06-13T01:59:53.174+0000 I NETWORK [ReplExecNetThread-4] SocketException: remote: 10.3.1.100:27017 error: 9001 socket exception [RECV_TIMEOUT] server [10.3.1.100:27017] 2015-06-13T01:59:53.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to ip-10-3-1-100:27017; HostUnreachable network error while attempting to run command 'replSetHeartbeat' on host 'ip-10-3-1-100:27017' with arguments '{ replSetHeartbeat: "rs0", pv: 1, v: 5, from: "10.3.1.101:27017", fromId: 1, checkEmpty: false }' and metadata '{}' 2015-06-13T01:59:53.186+0000 I REPL [ReplicationExecutor] Standing for election 2015-06-13T01:59:53.189+0000 I REPL [ReplicationExecutor] possible election tie; sleeping 357ms until 2015-06-13T01:59:53.546+0000 2015-06-13T01:59:53.546+0000 I REPL [ReplicationExecutor] Standing for election 2015-06-13T01:59:53.547+0000 I REPL [ReplicationExecutor] running for election 2015-06-13T01:59:53.549+0000 I REPL [ReplicationExecutor] received vote: 1 votes from 10.3.1.102:27017 2015-06-13T01:59:53.549+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role 2015-06-13T01:59:53.549+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2015-06-13T01:59:54.309+0000 I NETWORK [conn335] end connection 10.3.1.102:34052 (7 connections now open) 2015-06-13T01:59:54.309+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34054 #337 (8 connections now open) 2015-06-13T01:59:56.970+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2015-06-13T01:59:56.970+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state PRIMARY 2015-06-13T01:59:56.971+0000 I REPL [ReplicationExecutor] another primary seen with election time 557b89f3:1 my election time is 557b8e99:1 2015-06-13T01:59:56.971+0000 I REPL [ReplicationExecutor] another PRIMARY detected and it should step down since it was elected earlier than me 2015-06-13T01:59:56.971+0000 I REPL [ReplicationExecutor] Requesting ip-10-3-1-100:27017 step down from primary 2015-06-13T01:59:57.494+0000 I NETWORK [conn253] end connection 10.3.1.100:58595 (7 connections now open) 2015-06-13T01:59:57.494+0000 I NETWORK [conn254] end connection 10.3.1.100:58596 (6 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41588 #338 (7 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41589 #339 (8 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41590 #340 (9 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41592 #341 (10 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41595 #342 (11 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41594 #343 (12 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41591 #344 (13 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41597 #345 (14 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41596 #346 (15 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41598 #347 (16 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41599 #348 (17 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41600 #349 (18 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41601 #350 (19 connections now open) 2015-06-13T01:59:57.497+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41602 #351 (20 connections now open) 2015-06-13T01:59:57.498+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41603 #352 (21 connections now open) 2015-06-13T01:59:57.498+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41604 #353 (22 connections now open) 2015-06-13T01:59:57.498+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41605 #354 (23 connections now open) 2015-06-13T01:59:57.498+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41606 #355 (24 connections now open) 2015-06-13T01:59:57.506+0000 I SHARDING [conn351] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1087||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:59:57.506+0000 I SHARDING [conn340] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1087||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:59:57.506+0000 I SHARDING [conn338] remotely refreshing metadata for ycsb.usertable with requested shard version 2|1087||557b81da73ba23d09dea68fa, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 2015-06-13T01:59:57.508+0000 I NETWORK [conn338] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:59:57.508+0000 I NETWORK [conn351] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T01:59:57.509+0000 I NETWORK [conn338] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:59:57.509+0000 I NETWORK [conn351] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T01:59:57.509+0000 I NETWORK [conn338] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:59:57.509+0000 I NETWORK [conn351] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T01:59:57.519+0000 I SHARDING [conn340] collection ycsb.usertable was previously unsharded, new metadata loaded with shard version 2|1087||557b81da73ba23d09dea68fa 2015-06-13T01:59:57.519+0000 I SHARDING [conn340] collection version was loaded at version 2|1087||557b81da73ba23d09dea68fa, took 11ms 2015-06-13T01:59:57.521+0000 I SHARDING [conn351] metadata of collection ycsb.usertable already up to date (shard version : 2|1087||557b81da73ba23d09dea68fa, took 11ms) 2015-06-13T01:59:57.521+0000 I SHARDING [conn338] metadata of collection ycsb.usertable already up to date (shard version : 2|1087||557b81da73ba23d09dea68fa, took 11ms) 2015-06-13T01:59:57.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41607 #356 (25 connections now open) 2015-06-13T01:59:57.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41609 #357 (26 connections now open) 2015-06-13T01:59:57.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41608 #358 (27 connections now open) 2015-06-13T01:59:57.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41610 #359 (28 connections now open) 2015-06-13T01:59:57.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41611 #360 (29 connections now open) 2015-06-13T01:59:57.596+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41612 #361 (30 connections now open) 2015-06-13T01:59:57.780+0000 I REPL [ReplicationExecutor] another primary seen with election time 557b89f3:1 my election time is 557b8e99:1 2015-06-13T01:59:57.780+0000 I REPL [ReplicationExecutor] another PRIMARY detected and it should step down since it was elected earlier than me 2015-06-13T01:59:57.780+0000 I REPL [ReplicationExecutor] Requesting ip-10-3-1-100:27017 step down from primary 2015-06-13T01:59:58.971+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state SECONDARY 2015-06-13T01:59:58.973+0000 I REPL [ReplicationExecutor] Stepping down self (priority 0.5) because ip-10-3-1-100:27017 has higher priority 1 and is only 1 seconds behind me 2015-06-13T01:59:58.973+0000 I REPL [ReplicationExecutor] Stepping down from primary in response to heartbeat 2015-06-13T01:59:58.973+0000 I REPL [replExecDBWorker-2] transition to SECONDARY 2015-06-13T01:59:58.973+0000 I NETWORK [conn349] end connection 10.3.1.99:41600 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn343] end connection 10.3.1.99:41594 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn350] end connection 10.3.1.99:41601 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn338] end connection 10.3.1.99:41588 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn346] end connection 10.3.1.99:41596 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn344] end connection 10.3.1.99:41591 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn356] end connection 10.3.1.99:41607 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn250] end connection 10.3.1.103:55398 (28 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn342] end connection 10.3.1.99:41595 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn340] end connection 10.3.1.99:41590 (29 connections now open) 2015-06-13T01:59:58.973+0000 I NETWORK [conn244] end connection 10.3.1.99:41475 (24 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn352] end connection 10.3.1.99:41603 (20 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn355] end connection 10.3.1.99:41606 (18 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn345] end connection 10.3.1.99:41597 (16 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn341] end connection 10.3.1.99:41592 (15 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn354] end connection 10.3.1.99:41605 (14 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn348] end connection 10.3.1.99:41599 (13 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn347] end connection 10.3.1.99:41598 (13 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn251] end connection 10.3.1.102:33971 (12 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn339] end connection 10.3.1.99:41589 (12 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn360] end connection 10.3.1.99:41611 (10 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn358] end connection 10.3.1.99:41608 (13 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn361] end connection 10.3.1.99:41612 (8 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn357] end connection 10.3.1.99:41609 (8 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn353] end connection 10.3.1.99:41604 (11 connections now open) 2015-06-13T01:59:58.975+0000 I NETWORK [conn359] end connection 10.3.1.99:41610 (4 connections now open) 2015-06-13T01:59:58.974+0000 I NETWORK [conn351] end connection 10.3.1.99:41602 (12 connections now open) 2015-06-13T01:59:59.969+0000 I NETWORK [rsBackgroundSync] Socket flush send() errno:9 Bad file descriptor 10.3.1.100:27017 2015-06-13T01:59:59.969+0000 I - [rsBackgroundSync] caught exception (socket exception [SEND_ERROR] for 10.3.1.100:27017) in destructor (~PiggyBackData) 2015-06-13T02:00:00.973+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 7 secs ago 2015-06-13T02:00:01.834+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 8 secs ago 2015-06-13T02:00:02.002+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 8 secs ago 2015-06-13T02:00:02.277+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 8 secs ago 2015-06-13T02:00:02.618+0000 I NETWORK [conn249] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [10.3.1.102:33970] 2015-06-13T02:00:02.799+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41613 #362 (3 connections now open) 2015-06-13T02:00:02.800+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41614 #363 (4 connections now open) 2015-06-13T02:00:02.800+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41615 #364 (5 connections now open) 2015-06-13T02:00:02.800+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41617 #365 (6 connections now open) 2015-06-13T02:00:02.800+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.99:41616 #366 (7 connections now open) 2015-06-13T02:00:02.801+0000 I COMMAND [conn364] assertion while executing command 'update' on database 'ycsb' with arguments '{ update: "usertable", updates: [ { q: { _id: "user7921503549693673452" }, u: { $set: { field4: BinData(0, 3E383F2424353136313725352C2F343A2C3B20372B2D3F2E332C303B2E3F2A2639213A212C3E2D2F2129233B243A393620342F2A3D253525303D3038223D3A3D38332922233E...) } } } ], ordered: true, metadata: { shardName: "rs0", shardVersion: [ Timestamp 2000|1087, ObjectId('557b81da73ba23d09dea68fa') ], session: 0 } }' and metadata '{}': 10107 not master 2015-06-13T02:00:02.801+0000 I COMMAND [conn365] assertion while executing command 'update' on database 'ycsb' with arguments '{ update: "usertable", updates: [ { q: { _id: "user8865536793642263142" }, u: { $set: { field7: BinData(0, 242A3D31312A352B3230303D30343437212A3C263D23272239393D30333825203B262E2A3429232C273E2B382C35353822223D2E32222F263F2F2B26392F2F25353524383133...) } } } ], ordered: true, metadata: { shardName: "rs0", shardVersion: [ Timestamp 2000|1087, ObjectId('557b81da73ba23d09dea68fa') ], session: 0 } }' and metadata '{}': 10107 not master 2015-06-13T02:00:02.803+0000 I NETWORK [conn362] end connection 10.3.1.99:41613 (6 connections now open) 2015-06-13T02:00:02.805+0000 I NETWORK [conn363] end connection 10.3.1.99:41614 (5 connections now open) 2015-06-13T02:00:02.809+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.103:55546 #367 (6 connections now open) 2015-06-13T02:00:02.979+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 9 secs ago 2015-06-13T02:00:03.148+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 9 secs ago 2015-06-13T02:00:04.132+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 10 secs ago 2015-06-13T02:00:04.399+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.81:27019] 2015-06-13T02:00:04.400+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.82:27019] 2015-06-13T02:00:04.400+0000 I NETWORK [LockPinger] SyncClusterConnection connecting to [10.3.1.83:27019] 2015-06-13T02:00:04.664+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 11 secs ago 2015-06-13T02:00:04.678+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:00:04.400+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:00:04.962+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 11 secs ago 2015-06-13T02:00:05.559+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 12 secs ago 2015-06-13T02:00:05.635+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 12 secs ago 2015-06-13T02:00:09.067+0000 I NETWORK [conn336] end connection 10.3.1.100:58765 (5 connections now open) 2015-06-13T02:00:09.067+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58774 #368 (6 connections now open) 2015-06-13T02:00:15.782+0000 I NETWORK [ReplExecNetThread-4] Socket recv() timeout 10.3.1.102:27017 2015-06-13T02:00:15.782+0000 I NETWORK [ReplExecNetThread-4] SocketException: remote: 10.3.1.102:27017 error: 9001 socket exception [RECV_TIMEOUT] server [10.3.1.102:27017] 2015-06-13T02:00:15.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to 10.3.1.102:27017; HostUnreachable network error while attempting to run command 'replSetHeartbeat' on host '10.3.1.102:27017' with arguments '{ replSetHeartbeat: "rs0", pv: 1, v: 5, from: "10.3.1.101:27017", fromId: 1, checkEmpty: false }' and metadata '{}' 2015-06-13T02:00:17.418+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 23 secs ago 2015-06-13T02:00:17.784+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state SECONDARY 2015-06-13T02:00:18.054+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 24 secs ago 2015-06-13T02:00:18.271+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 24 secs ago 2015-06-13T02:00:19.022+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T02:00:19.512+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 25 secs ago 2015-06-13T02:00:20.216+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 26 secs ago 2015-06-13T02:00:20.492+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 26 secs ago 2015-06-13T02:00:20.904+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 27 secs ago 2015-06-13T02:00:21.119+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 27 secs ago 2015-06-13T02:00:21.627+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 28 secs ago 2015-06-13T02:00:22.074+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 28 secs ago 2015-06-13T02:00:22.942+0000 I REPL [ReplicationExecutor] replSet voting no for ip-10-3-1-100:27017; voted for 10.3.1.101:27017 29 secs ago 2015-06-13T02:00:23.673+0000 I REPL [ReplicationExecutor] replSetElect voting yea for ip-10-3-1-100:27017 (0) 2015-06-13T02:00:24.979+0000 I REPL [ReplicationExecutor] Member ip-10-3-1-100:27017 is now in state PRIMARY 2015-06-13T02:00:25.163+0000 I NETWORK [conn337] end connection 10.3.1.102:34054 (5 connections now open) 2015-06-13T02:00:25.164+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34056 #369 (6 connections now open) 2015-06-13T02:00:25.974+0000 I REPL [ReplicationExecutor] syncing from: ip-10-3-1-100:27017 2015-06-13T02:00:25.976+0000 I NETWORK [SyncSourceFeedback] Socket say send() errno:9 Bad file descriptor 10.3.1.100:27017 2015-06-13T02:00:25.988+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update: socket exception [SEND_ERROR] for 10.3.1.100:27017 2015-06-13T02:00:26.809+0000 I REPL [ReplicationExecutor] could not find member to sync from 2015-06-13T02:00:27.810+0000 I REPL [ReplicationExecutor] syncing from: 10.3.1.102:27017 2015-06-13T02:00:27.989+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 10.3.1.102:27017 2015-06-13T02:00:34.854+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:00:34.678+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:00:39.079+0000 I NETWORK [conn368] end connection 10.3.1.100:58774 (5 connections now open) 2015-06-13T02:00:39.080+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58785 #370 (7 connections now open) 2015-06-13T02:00:55.174+0000 I NETWORK [conn369] end connection 10.3.1.102:34056 (5 connections now open) 2015-06-13T02:00:55.174+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34060 #371 (6 connections now open) 2015-06-13T02:01:10.126+0000 I NETWORK [conn370] end connection 10.3.1.100:58785 (5 connections now open) 2015-06-13T02:01:10.126+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58787 #372 (6 connections now open) 2015-06-13T02:01:10.427+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:01:10.112+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:01:25.184+0000 I NETWORK [conn371] end connection 10.3.1.102:34060 (5 connections now open) 2015-06-13T02:01:25.185+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34062 #373 (6 connections now open) 2015-06-13T02:01:40.136+0000 I NETWORK [conn372] end connection 10.3.1.100:58787 (5 connections now open) 2015-06-13T02:01:40.137+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58789 #374 (6 connections now open) 2015-06-13T02:01:40.707+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:01:40.427+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:01:55.197+0000 I NETWORK [conn373] end connection 10.3.1.102:34062 (5 connections now open) 2015-06-13T02:01:55.197+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34064 #375 (6 connections now open) 2015-06-13T02:02:10.152+0000 I NETWORK [conn374] end connection 10.3.1.100:58789 (5 connections now open) 2015-06-13T02:02:10.153+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58791 #376 (7 connections now open) 2015-06-13T02:02:10.990+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:02:10.707+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:02:25.209+0000 I NETWORK [conn375] end connection 10.3.1.102:34064 (5 connections now open) 2015-06-13T02:02:25.210+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34066 #377 (6 connections now open) 2015-06-13T02:02:41.767+0000 I NETWORK [conn376] end connection 10.3.1.100:58791 (5 connections now open) 2015-06-13T02:02:41.768+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58793 #378 (6 connections now open) 2015-06-13T02:02:45.949+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:02:45.754+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:02:55.225+0000 I NETWORK [conn377] end connection 10.3.1.102:34066 (5 connections now open) 2015-06-13T02:02:55.225+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34068 #379 (6 connections now open) 2015-06-13T02:03:11.802+0000 I NETWORK [conn378] end connection 10.3.1.100:58793 (5 connections now open) 2015-06-13T02:03:11.803+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58795 #380 (6 connections now open) 2015-06-13T02:03:16.127+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:03:15.949+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:03:25.234+0000 I NETWORK [conn379] end connection 10.3.1.102:34068 (5 connections now open) 2015-06-13T02:03:25.234+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34070 #381 (6 connections now open) 2015-06-13T02:03:29.070+0000 I NETWORK [ReplExecNetThread-4] Socket recv() timeout 10.3.1.102:27017 2015-06-13T02:03:29.070+0000 I NETWORK [ReplExecNetThread-4] SocketException: remote: 10.3.1.102:27017 error: 9001 socket exception [RECV_TIMEOUT] server [10.3.1.102:27017] 2015-06-13T02:03:29.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to 10.3.1.102:27017; HostUnreachable network error while attempting to run command 'replSetHeartbeat' on host '10.3.1.102:27017' with arguments '{ replSetHeartbeat: "rs0", pv: 1, v: 5, from: "10.3.1.101:27017", fromId: 1, checkEmpty: false }' and metadata '{}' 2015-06-13T02:03:31.570+0000 I REPL [ReplicationExecutor] Member 10.3.1.102:27017 is now in state SECONDARY 2015-06-13T02:03:41.815+0000 I NETWORK [conn380] end connection 10.3.1.100:58795 (5 connections now open) 2015-06-13T02:03:41.815+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58797 #382 (6 connections now open) 2015-06-13T02:03:46.339+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:03:46.127+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:03:55.247+0000 I NETWORK [conn381] end connection 10.3.1.102:34070 (5 connections now open) 2015-06-13T02:03:55.248+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34072 #383 (6 connections now open) 2015-06-13T02:04:11.829+0000 I NETWORK [conn382] end connection 10.3.1.100:58797 (5 connections now open) 2015-06-13T02:04:11.829+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58799 #384 (6 connections now open) 2015-06-13T02:04:18.122+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:04:17.932+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:04:25.258+0000 I NETWORK [conn383] end connection 10.3.1.102:34072 (5 connections now open) 2015-06-13T02:04:25.258+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34074 #385 (6 connections now open) 2015-06-13T02:04:41.839+0000 I NETWORK [conn384] end connection 10.3.1.100:58799 (5 connections now open) 2015-06-13T02:04:41.840+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58801 #386 (6 connections now open) 2015-06-13T02:04:48.299+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:04:48.122+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:04:55.269+0000 I NETWORK [conn385] end connection 10.3.1.102:34074 (5 connections now open) 2015-06-13T02:04:55.269+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34076 #387 (6 connections now open) 2015-06-13T02:05:11.864+0000 I NETWORK [conn386] end connection 10.3.1.100:58801 (5 connections now open) 2015-06-13T02:05:11.864+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58803 #388 (6 connections now open) 2015-06-13T02:05:18.442+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:05:18.300+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:05:25.282+0000 I NETWORK [conn387] end connection 10.3.1.102:34076 (5 connections now open) 2015-06-13T02:05:25.286+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34078 #389 (6 connections now open) 2015-06-13T02:05:41.873+0000 I NETWORK [conn388] end connection 10.3.1.100:58803 (5 connections now open) 2015-06-13T02:05:41.873+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58805 #390 (6 connections now open) 2015-06-13T02:05:54.117+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:05:53.960+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:05:55.305+0000 I NETWORK [conn389] end connection 10.3.1.102:34078 (5 connections now open) 2015-06-13T02:05:55.305+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34080 #391 (6 connections now open) 2015-06-13T02:06:11.886+0000 I NETWORK [conn390] end connection 10.3.1.100:58805 (5 connections now open) 2015-06-13T02:06:11.887+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58807 #392 (6 connections now open) 2015-06-13T02:06:24.260+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:06:24.117+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:06:25.319+0000 I NETWORK [conn391] end connection 10.3.1.102:34080 (5 connections now open) 2015-06-13T02:06:25.319+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34082 #393 (6 connections now open) 2015-06-13T02:06:41.900+0000 I NETWORK [conn392] end connection 10.3.1.100:58807 (5 connections now open) 2015-06-13T02:06:41.900+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58809 #394 (6 connections now open) 2015-06-13T02:06:54.405+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:06:54.260+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:06:55.335+0000 I NETWORK [conn393] end connection 10.3.1.102:34082 (5 connections now open) 2015-06-13T02:06:55.335+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34084 #395 (7 connections now open) 2015-06-13T02:07:11.916+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58811 #396 (7 connections now open) 2015-06-13T02:07:11.916+0000 I NETWORK [conn394] end connection 10.3.1.100:58809 (6 connections now open) 2015-06-13T02:07:26.748+0000 I NETWORK [conn395] end connection 10.3.1.102:34084 (5 connections now open) 2015-06-13T02:07:26.749+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34086 #397 (6 connections now open) 2015-06-13T02:07:26.904+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:07:26.738+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:07:41.927+0000 I NETWORK [conn396] end connection 10.3.1.100:58811 (5 connections now open) 2015-06-13T02:07:41.927+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58813 #398 (6 connections now open) 2015-06-13T02:07:56.770+0000 I NETWORK [conn397] end connection 10.3.1.102:34086 (5 connections now open) 2015-06-13T02:07:56.771+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34088 #399 (6 connections now open) 2015-06-13T02:07:57.049+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:07:56.905+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:08:11.941+0000 I NETWORK [conn398] end connection 10.3.1.100:58813 (5 connections now open) 2015-06-13T02:08:11.941+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58815 #400 (6 connections now open) 2015-06-13T02:08:20.977+0000 I NETWORK [conn367] end connection 10.3.1.103:55546 (5 connections now open) 2015-06-13T02:08:26.784+0000 I NETWORK [conn399] end connection 10.3.1.102:34088 (4 connections now open) 2015-06-13T02:08:26.784+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34090 #401 (6 connections now open) 2015-06-13T02:08:27.192+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:08:27.050+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:08:32.255+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.103:55586 #402 (6 connections now open) 2015-06-13T02:08:41.955+0000 I NETWORK [conn400] end connection 10.3.1.100:58815 (5 connections now open) 2015-06-13T02:08:41.955+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58819 #403 (6 connections now open) 2015-06-13T02:08:58.568+0000 I NETWORK [conn401] end connection 10.3.1.102:34090 (5 connections now open) 2015-06-13T02:08:58.569+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34092 #404 (6 connections now open) 2015-06-13T02:09:00.718+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:09:00.559+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:09:11.973+0000 I NETWORK [conn403] end connection 10.3.1.100:58819 (5 connections now open) 2015-06-13T02:09:11.973+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58821 #405 (6 connections now open) 2015-06-13T02:09:28.573+0000 I NETWORK [conn404] end connection 10.3.1.102:34092 (5 connections now open) 2015-06-13T02:09:28.574+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34094 #406 (6 connections now open) 2015-06-13T02:09:30.861+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:09:30.718+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:09:41.989+0000 I NETWORK [conn405] end connection 10.3.1.100:58821 (5 connections now open) 2015-06-13T02:09:41.990+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58823 #407 (6 connections now open) 2015-06-13T02:09:58.583+0000 I NETWORK [conn406] end connection 10.3.1.102:34094 (5 connections now open) 2015-06-13T02:09:58.584+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34096 #408 (7 connections now open) 2015-06-13T02:10:01.004+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:10:00.861+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:10:12.005+0000 I NETWORK [conn407] end connection 10.3.1.100:58823 (5 connections now open) 2015-06-13T02:10:12.006+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58825 #409 (6 connections now open) 2015-06-13T02:10:29.228+0000 I NETWORK [conn408] end connection 10.3.1.102:34096 (5 connections now open) 2015-06-13T02:10:29.229+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34098 #410 (6 connections now open) 2015-06-13T02:10:31.355+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:10:31.220+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:10:42.021+0000 I NETWORK [conn409] end connection 10.3.1.100:58825 (5 connections now open) 2015-06-13T02:10:42.023+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58827 #411 (6 connections now open) 2015-06-13T02:10:59.240+0000 I NETWORK [conn410] end connection 10.3.1.102:34098 (5 connections now open) 2015-06-13T02:10:59.242+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34100 #412 (6 connections now open) 2015-06-13T02:11:01.499+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:11:01.355+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:11:12.040+0000 I NETWORK [conn411] end connection 10.3.1.100:58827 (5 connections now open) 2015-06-13T02:11:12.040+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58830 #413 (6 connections now open) 2015-06-13T02:11:29.264+0000 I NETWORK [conn412] end connection 10.3.1.102:34100 (5 connections now open) 2015-06-13T02:11:29.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34102 #414 (7 connections now open) 2015-06-13T02:11:31.641+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:11:31.499+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:11:42.052+0000 I NETWORK [conn413] end connection 10.3.1.100:58830 (5 connections now open) 2015-06-13T02:11:42.053+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58832 #415 (7 connections now open) 2015-06-13T02:12:00.664+0000 I NETWORK [conn414] end connection 10.3.1.102:34102 (5 connections now open) 2015-06-13T02:12:00.664+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34104 #416 (6 connections now open) 2015-06-13T02:12:04.791+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:12:04.654+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:12:12.280+0000 I NETWORK [conn415] end connection 10.3.1.100:58832 (5 connections now open) 2015-06-13T02:12:12.286+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58834 #417 (6 connections now open) 2015-06-13T02:12:30.675+0000 I NETWORK [conn416] end connection 10.3.1.102:34104 (5 connections now open) 2015-06-13T02:12:30.676+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34106 #418 (6 connections now open) 2015-06-13T02:12:34.935+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:12:34.791+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:12:42.298+0000 I NETWORK [conn417] end connection 10.3.1.100:58834 (5 connections now open) 2015-06-13T02:12:42.299+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58836 #419 (6 connections now open) 2015-06-13T02:13:00.694+0000 I NETWORK [conn418] end connection 10.3.1.102:34106 (5 connections now open) 2015-06-13T02:13:00.694+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34109 #420 (6 connections now open) 2015-06-13T02:13:05.079+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:13:04.935+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:13:12.313+0000 I NETWORK [conn419] end connection 10.3.1.100:58836 (5 connections now open) 2015-06-13T02:13:12.314+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58838 #421 (7 connections now open) 2015-06-13T02:13:30.705+0000 I NETWORK [conn420] end connection 10.3.1.102:34109 (5 connections now open) 2015-06-13T02:13:30.705+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34111 #422 (6 connections now open) 2015-06-13T02:13:35.227+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:13:35.079+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:13:43.629+0000 I NETWORK [conn421] end connection 10.3.1.100:58838 (5 connections now open) 2015-06-13T02:13:43.630+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58840 #423 (6 connections now open) 2015-06-13T02:14:00.718+0000 I NETWORK [conn422] end connection 10.3.1.102:34111 (5 connections now open) 2015-06-13T02:14:00.718+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34113 #424 (6 connections now open) 2015-06-13T02:14:05.407+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:14:05.227+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:14:13.643+0000 I NETWORK [conn423] end connection 10.3.1.100:58840 (5 connections now open) 2015-06-13T02:14:13.643+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58842 #425 (6 connections now open) 2015-06-13T02:14:30.727+0000 I NETWORK [conn424] end connection 10.3.1.102:34113 (5 connections now open) 2015-06-13T02:14:30.727+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34115 #426 (6 connections now open) 2015-06-13T02:14:35.580+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:14:35.407+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:14:43.655+0000 I NETWORK [conn425] end connection 10.3.1.100:58842 (5 connections now open) 2015-06-13T02:14:43.656+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58844 #427 (6 connections now open) 2015-06-13T02:15:00.737+0000 I NETWORK [conn426] end connection 10.3.1.102:34115 (5 connections now open) 2015-06-13T02:15:00.737+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34117 #428 (6 connections now open) 2015-06-13T02:15:09.037+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:15:08.850+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:15:13.667+0000 I NETWORK [conn427] end connection 10.3.1.100:58844 (5 connections now open) 2015-06-13T02:15:13.667+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58846 #429 (6 connections now open) 2015-06-13T02:15:30.751+0000 I NETWORK [conn428] end connection 10.3.1.102:34117 (5 connections now open) 2015-06-13T02:15:30.751+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34119 #430 (6 connections now open) 2015-06-13T02:15:39.283+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:15:39.038+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:15:43.677+0000 I NETWORK [conn429] end connection 10.3.1.100:58846 (5 connections now open) 2015-06-13T02:15:43.677+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58848 #431 (6 connections now open) 2015-06-13T02:16:00.764+0000 I NETWORK [conn430] end connection 10.3.1.102:34119 (5 connections now open) 2015-06-13T02:16:00.764+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34121 #432 (6 connections now open) 2015-06-13T02:16:09.530+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:16:09.283+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:16:13.690+0000 I NETWORK [conn431] end connection 10.3.1.100:58848 (5 connections now open) 2015-06-13T02:16:13.690+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58850 #433 (6 connections now open) 2015-06-13T02:16:30.779+0000 I NETWORK [conn432] end connection 10.3.1.102:34121 (5 connections now open) 2015-06-13T02:16:30.779+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34123 #434 (6 connections now open) 2015-06-13T02:16:39.717+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:16:39.531+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:16:43.703+0000 I NETWORK [conn433] end connection 10.3.1.100:58850 (5 connections now open) 2015-06-13T02:16:43.703+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58852 #435 (6 connections now open) 2015-06-13T02:17:00.793+0000 I NETWORK [conn434] end connection 10.3.1.102:34123 (5 connections now open) 2015-06-13T02:17:00.793+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34125 #436 (6 connections now open) 2015-06-13T02:17:09.965+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:17:09.717+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:17:13.715+0000 I NETWORK [conn435] end connection 10.3.1.100:58852 (5 connections now open) 2015-06-13T02:17:13.715+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58854 #437 (6 connections now open) 2015-06-13T02:17:30.807+0000 I NETWORK [conn436] end connection 10.3.1.102:34125 (5 connections now open) 2015-06-13T02:17:30.807+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34127 #438 (6 connections now open) 2015-06-13T02:17:40.221+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:17:39.966+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:17:43.726+0000 I NETWORK [conn437] end connection 10.3.1.100:58854 (5 connections now open) 2015-06-13T02:17:43.727+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58856 #439 (6 connections now open) 2015-06-13T02:18:00.820+0000 I NETWORK [conn438] end connection 10.3.1.102:34127 (5 connections now open) 2015-06-13T02:18:00.820+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34129 #440 (6 connections now open) 2015-06-13T02:18:10.507+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:18:10.221+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:18:13.734+0000 I NETWORK [conn439] end connection 10.3.1.100:58856 (5 connections now open) 2015-06-13T02:18:13.735+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58858 #441 (6 connections now open) 2015-06-13T02:18:30.834+0000 I NETWORK [conn440] end connection 10.3.1.102:34129 (5 connections now open) 2015-06-13T02:18:30.834+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34131 #442 (6 connections now open) 2015-06-13T02:18:40.795+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:18:40.507+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:18:43.745+0000 I NETWORK [conn441] end connection 10.3.1.100:58858 (5 connections now open) 2015-06-13T02:18:43.745+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58860 #443 (6 connections now open) 2015-06-13T02:19:00.849+0000 I NETWORK [conn442] end connection 10.3.1.102:34131 (5 connections now open) 2015-06-13T02:19:00.849+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34133 #444 (6 connections now open) 2015-06-13T02:19:11.075+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:19:10.795+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:19:13.756+0000 I NETWORK [conn443] end connection 10.3.1.100:58860 (5 connections now open) 2015-06-13T02:19:13.756+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58862 #445 (6 connections now open) 2015-06-13T02:19:30.862+0000 I NETWORK [conn444] end connection 10.3.1.102:34133 (5 connections now open) 2015-06-13T02:19:30.863+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34135 #446 (6 connections now open) 2015-06-13T02:19:41.286+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:19:41.075+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:19:43.767+0000 I NETWORK [conn445] end connection 10.3.1.100:58862 (5 connections now open) 2015-06-13T02:19:43.767+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58864 #447 (6 connections now open) 2015-06-13T02:20:00.876+0000 I NETWORK [conn446] end connection 10.3.1.102:34135 (5 connections now open) 2015-06-13T02:20:00.876+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34137 #448 (6 connections now open) 2015-06-13T02:20:11.569+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:20:11.286+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:20:13.775+0000 I NETWORK [conn447] end connection 10.3.1.100:58864 (5 connections now open) 2015-06-13T02:20:13.776+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58866 #449 (6 connections now open) 2015-06-13T02:20:30.890+0000 I NETWORK [conn448] end connection 10.3.1.102:34137 (5 connections now open) 2015-06-13T02:20:30.890+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34139 #450 (6 connections now open) 2015-06-13T02:20:41.849+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:20:41.570+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:20:43.788+0000 I NETWORK [conn449] end connection 10.3.1.100:58866 (5 connections now open) 2015-06-13T02:20:43.788+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58868 #451 (6 connections now open) 2015-06-13T02:21:00.904+0000 I NETWORK [conn450] end connection 10.3.1.102:34139 (5 connections now open) 2015-06-13T02:21:00.904+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34141 #452 (6 connections now open) 2015-06-13T02:21:12.130+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:21:11.849+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:21:13.797+0000 I NETWORK [conn451] end connection 10.3.1.100:58868 (5 connections now open) 2015-06-13T02:21:13.797+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58870 #453 (6 connections now open) 2015-06-13T02:21:30.918+0000 I NETWORK [conn452] end connection 10.3.1.102:34141 (5 connections now open) 2015-06-13T02:21:30.919+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34143 #454 (6 connections now open) 2015-06-13T02:21:42.410+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:21:42.130+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:21:43.806+0000 I NETWORK [conn453] end connection 10.3.1.100:58870 (5 connections now open) 2015-06-13T02:21:43.807+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58872 #455 (6 connections now open) 2015-06-13T02:22:00.932+0000 I NETWORK [conn454] end connection 10.3.1.102:34143 (5 connections now open) 2015-06-13T02:22:00.932+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34145 #456 (6 connections now open) 2015-06-13T02:22:12.628+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:22:12.410+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:22:13.820+0000 I NETWORK [conn455] end connection 10.3.1.100:58872 (5 connections now open) 2015-06-13T02:22:13.820+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58874 #457 (6 connections now open) 2015-06-13T02:22:30.947+0000 I NETWORK [conn456] end connection 10.3.1.102:34145 (5 connections now open) 2015-06-13T02:22:30.947+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34147 #458 (6 connections now open) 2015-06-13T02:22:42.805+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:22:42.628+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:22:43.832+0000 I NETWORK [conn457] end connection 10.3.1.100:58874 (5 connections now open) 2015-06-13T02:22:43.832+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58876 #459 (6 connections now open) 2015-06-13T02:23:00.960+0000 I NETWORK [conn458] end connection 10.3.1.102:34147 (5 connections now open) 2015-06-13T02:23:00.961+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34149 #460 (6 connections now open) 2015-06-13T02:23:13.083+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:23:12.805+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:23:13.843+0000 I NETWORK [conn459] end connection 10.3.1.100:58876 (5 connections now open) 2015-06-13T02:23:13.843+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58878 #461 (6 connections now open) 2015-06-13T02:23:30.975+0000 I NETWORK [conn460] end connection 10.3.1.102:34149 (5 connections now open) 2015-06-13T02:23:30.975+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34151 #462 (6 connections now open) 2015-06-13T02:23:43.363+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:23:43.084+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:23:43.853+0000 I NETWORK [conn461] end connection 10.3.1.100:58878 (5 connections now open) 2015-06-13T02:23:43.853+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58880 #463 (6 connections now open) 2015-06-13T02:24:00.989+0000 I NETWORK [conn462] end connection 10.3.1.102:34151 (5 connections now open) 2015-06-13T02:24:00.989+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34153 #464 (6 connections now open) 2015-06-13T02:24:13.511+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:24:13.363+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:24:13.864+0000 I NETWORK [conn463] end connection 10.3.1.100:58880 (5 connections now open) 2015-06-13T02:24:13.864+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58882 #465 (6 connections now open) 2015-06-13T02:24:31.003+0000 I NETWORK [conn464] end connection 10.3.1.102:34153 (5 connections now open) 2015-06-13T02:24:31.004+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34155 #466 (6 connections now open) 2015-06-13T02:24:43.657+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:24:43.511+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:24:43.876+0000 I NETWORK [conn465] end connection 10.3.1.100:58882 (5 connections now open) 2015-06-13T02:24:43.876+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58884 #467 (6 connections now open) 2015-06-13T02:25:01.014+0000 I NETWORK [conn466] end connection 10.3.1.102:34155 (5 connections now open) 2015-06-13T02:25:01.014+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34157 #468 (6 connections now open) 2015-06-13T02:25:13.800+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:25:13.657+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:25:13.888+0000 I NETWORK [conn467] end connection 10.3.1.100:58884 (5 connections now open) 2015-06-13T02:25:13.888+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58886 #469 (6 connections now open) 2015-06-13T02:25:31.029+0000 I NETWORK [conn468] end connection 10.3.1.102:34157 (5 connections now open) 2015-06-13T02:25:31.029+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34159 #470 (6 connections now open) 2015-06-13T02:25:43.898+0000 I NETWORK [conn469] end connection 10.3.1.100:58886 (5 connections now open) 2015-06-13T02:25:43.898+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58888 #471 (6 connections now open) 2015-06-13T02:25:43.946+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:25:43.801+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:26:01.042+0000 I NETWORK [conn470] end connection 10.3.1.102:34159 (5 connections now open) 2015-06-13T02:26:01.042+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34161 #472 (6 connections now open) 2015-06-13T02:26:13.907+0000 I NETWORK [conn471] end connection 10.3.1.100:58888 (5 connections now open) 2015-06-13T02:26:13.907+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58890 #473 (6 connections now open) 2015-06-13T02:26:14.090+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:26:13.947+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:26:31.056+0000 I NETWORK [conn472] end connection 10.3.1.102:34161 (5 connections now open) 2015-06-13T02:26:31.056+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34163 #474 (6 connections now open) 2015-06-13T02:26:43.916+0000 I NETWORK [conn473] end connection 10.3.1.100:58890 (5 connections now open) 2015-06-13T02:26:43.916+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58892 #475 (6 connections now open) 2015-06-13T02:26:44.232+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:26:44.090+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:27:01.072+0000 I NETWORK [conn474] end connection 10.3.1.102:34163 (5 connections now open) 2015-06-13T02:27:01.072+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34165 #476 (6 connections now open) 2015-06-13T02:27:13.927+0000 I NETWORK [conn475] end connection 10.3.1.100:58892 (5 connections now open) 2015-06-13T02:27:13.927+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58894 #477 (6 connections now open) 2015-06-13T02:27:14.380+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:27:14.232+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:27:31.086+0000 I NETWORK [conn476] end connection 10.3.1.102:34165 (5 connections now open) 2015-06-13T02:27:31.086+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34167 #478 (6 connections now open) 2015-06-13T02:27:43.938+0000 I NETWORK [conn477] end connection 10.3.1.100:58894 (5 connections now open) 2015-06-13T02:27:43.939+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58896 #479 (6 connections now open) 2015-06-13T02:27:44.523+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:27:44.380+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:28:01.098+0000 I NETWORK [conn478] end connection 10.3.1.102:34167 (5 connections now open) 2015-06-13T02:28:01.098+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34169 #480 (6 connections now open) 2015-06-13T02:28:13.950+0000 I NETWORK [conn479] end connection 10.3.1.100:58896 (5 connections now open) 2015-06-13T02:28:13.951+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58898 #481 (6 connections now open) 2015-06-13T02:28:14.666+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:28:14.523+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:28:31.111+0000 I NETWORK [conn480] end connection 10.3.1.102:34169 (5 connections now open) 2015-06-13T02:28:31.111+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34171 #482 (6 connections now open) 2015-06-13T02:28:43.963+0000 I NETWORK [conn481] end connection 10.3.1.100:58898 (5 connections now open) 2015-06-13T02:28:43.963+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58900 #483 (6 connections now open) 2015-06-13T02:28:44.842+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:28:44.666+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:29:01.124+0000 I NETWORK [conn482] end connection 10.3.1.102:34171 (5 connections now open) 2015-06-13T02:29:01.124+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34173 #484 (6 connections now open) 2015-06-13T02:29:13.977+0000 I NETWORK [conn483] end connection 10.3.1.100:58900 (5 connections now open) 2015-06-13T02:29:13.977+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58902 #485 (6 connections now open) 2015-06-13T02:29:14.990+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:29:14.842+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:29:31.136+0000 I NETWORK [conn484] end connection 10.3.1.102:34173 (5 connections now open) 2015-06-13T02:29:31.137+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34175 #486 (6 connections now open) 2015-06-13T02:29:43.989+0000 I NETWORK [conn485] end connection 10.3.1.100:58902 (5 connections now open) 2015-06-13T02:29:43.989+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58904 #487 (6 connections now open) 2015-06-13T02:29:45.133+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:29:44.990+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:30:01.150+0000 I NETWORK [conn486] end connection 10.3.1.102:34175 (5 connections now open) 2015-06-13T02:30:01.151+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34177 #488 (6 connections now open) 2015-06-13T02:30:14.002+0000 I NETWORK [conn487] end connection 10.3.1.100:58904 (5 connections now open) 2015-06-13T02:30:14.002+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58906 #489 (6 connections now open) 2015-06-13T02:30:15.277+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:30:15.133+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:30:31.164+0000 I NETWORK [conn488] end connection 10.3.1.102:34177 (5 connections now open) 2015-06-13T02:30:31.164+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34179 #490 (6 connections now open) 2015-06-13T02:30:44.015+0000 I NETWORK [conn489] end connection 10.3.1.100:58906 (5 connections now open) 2015-06-13T02:30:44.016+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58908 #491 (6 connections now open) 2015-06-13T02:30:45.423+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:30:45.277+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:31:01.175+0000 I NETWORK [conn490] end connection 10.3.1.102:34179 (5 connections now open) 2015-06-13T02:31:01.176+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34181 #492 (6 connections now open) 2015-06-13T02:31:14.025+0000 I NETWORK [conn491] end connection 10.3.1.100:58908 (5 connections now open) 2015-06-13T02:31:14.026+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58910 #493 (6 connections now open) 2015-06-13T02:31:15.567+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:31:15.423+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:31:31.193+0000 I NETWORK [conn492] end connection 10.3.1.102:34181 (5 connections now open) 2015-06-13T02:31:31.193+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34183 #494 (6 connections now open) 2015-06-13T02:31:44.034+0000 I NETWORK [conn493] end connection 10.3.1.100:58910 (5 connections now open) 2015-06-13T02:31:44.035+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58912 #495 (6 connections now open) 2015-06-13T02:31:45.711+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:31:45.567+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:32:01.207+0000 I NETWORK [conn494] end connection 10.3.1.102:34183 (5 connections now open) 2015-06-13T02:32:01.207+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34185 #496 (6 connections now open) 2015-06-13T02:32:14.046+0000 I NETWORK [conn495] end connection 10.3.1.100:58912 (5 connections now open) 2015-06-13T02:32:14.047+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58914 #497 (6 connections now open) 2015-06-13T02:32:15.857+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:32:15.711+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:32:31.220+0000 I NETWORK [conn496] end connection 10.3.1.102:34185 (5 connections now open) 2015-06-13T02:32:31.220+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34187 #498 (6 connections now open) 2015-06-13T02:32:44.058+0000 I NETWORK [conn497] end connection 10.3.1.100:58914 (5 connections now open) 2015-06-13T02:32:44.058+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58916 #499 (6 connections now open) 2015-06-13T02:32:45.999+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:32:45.857+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:33:01.233+0000 I NETWORK [conn498] end connection 10.3.1.102:34187 (5 connections now open) 2015-06-13T02:33:01.234+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34189 #500 (6 connections now open) 2015-06-13T02:33:14.071+0000 I NETWORK [conn499] end connection 10.3.1.100:58916 (5 connections now open) 2015-06-13T02:33:14.071+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58918 #501 (6 connections now open) 2015-06-13T02:33:16.142+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:33:15.999+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:33:31.247+0000 I NETWORK [conn500] end connection 10.3.1.102:34189 (5 connections now open) 2015-06-13T02:33:31.247+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34191 #502 (6 connections now open) 2015-06-13T02:33:44.082+0000 I NETWORK [conn501] end connection 10.3.1.100:58918 (5 connections now open) 2015-06-13T02:33:44.082+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58920 #503 (6 connections now open) 2015-06-13T02:33:46.421+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:33:46.142+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:34:01.260+0000 I NETWORK [conn502] end connection 10.3.1.102:34191 (5 connections now open) 2015-06-13T02:34:01.261+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34193 #504 (6 connections now open) 2015-06-13T02:34:14.094+0000 I NETWORK [conn503] end connection 10.3.1.100:58920 (5 connections now open) 2015-06-13T02:34:14.094+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58922 #505 (6 connections now open) 2015-06-13T02:34:16.704+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:34:16.421+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:34:31.274+0000 I NETWORK [conn504] end connection 10.3.1.102:34193 (5 connections now open) 2015-06-13T02:34:31.275+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34195 #506 (6 connections now open) 2015-06-13T02:34:44.105+0000 I NETWORK [conn505] end connection 10.3.1.100:58922 (5 connections now open) 2015-06-13T02:34:44.105+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58924 #507 (6 connections now open) 2015-06-13T02:34:46.917+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:34:46.704+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:35:01.288+0000 I NETWORK [conn506] end connection 10.3.1.102:34195 (5 connections now open) 2015-06-13T02:35:01.288+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34197 #508 (6 connections now open) 2015-06-13T02:35:14.114+0000 I NETWORK [conn507] end connection 10.3.1.100:58924 (5 connections now open) 2015-06-13T02:35:14.114+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58926 #509 (6 connections now open) 2015-06-13T02:35:17.094+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:35:16.917+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:35:31.298+0000 I NETWORK [conn508] end connection 10.3.1.102:34197 (5 connections now open) 2015-06-13T02:35:31.299+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34199 #510 (6 connections now open) 2015-06-13T02:35:44.126+0000 I NETWORK [conn509] end connection 10.3.1.100:58926 (5 connections now open) 2015-06-13T02:35:44.126+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58928 #511 (6 connections now open) 2015-06-13T02:35:47.375+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:35:47.095+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:36:01.310+0000 I NETWORK [conn510] end connection 10.3.1.102:34199 (5 connections now open) 2015-06-13T02:36:01.310+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34201 #512 (6 connections now open) 2015-06-13T02:36:14.138+0000 I NETWORK [conn511] end connection 10.3.1.100:58928 (5 connections now open) 2015-06-13T02:36:14.138+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58930 #513 (6 connections now open) 2015-06-13T02:36:17.554+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:36:17.376+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:36:31.320+0000 I NETWORK [conn512] end connection 10.3.1.102:34201 (5 connections now open) 2015-06-13T02:36:31.321+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34203 #514 (6 connections now open) 2015-06-13T02:36:44.151+0000 I NETWORK [conn513] end connection 10.3.1.100:58930 (5 connections now open) 2015-06-13T02:36:44.152+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58932 #515 (6 connections now open) 2015-06-13T02:36:47.732+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:36:47.554+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:37:01.333+0000 I NETWORK [conn514] end connection 10.3.1.102:34203 (5 connections now open) 2015-06-13T02:37:01.333+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34205 #516 (6 connections now open) 2015-06-13T02:37:14.164+0000 I NETWORK [conn515] end connection 10.3.1.100:58932 (5 connections now open) 2015-06-13T02:37:14.164+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58934 #517 (6 connections now open) 2015-06-13T02:37:17.880+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:37:17.732+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:37:31.346+0000 I NETWORK [conn516] end connection 10.3.1.102:34205 (5 connections now open) 2015-06-13T02:37:31.347+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34207 #518 (6 connections now open) 2015-06-13T02:37:44.178+0000 I NETWORK [conn517] end connection 10.3.1.100:58934 (5 connections now open) 2015-06-13T02:37:44.178+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58936 #519 (6 connections now open) 2015-06-13T02:37:48.023+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:37:47.880+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:38:01.360+0000 I NETWORK [conn518] end connection 10.3.1.102:34207 (5 connections now open) 2015-06-13T02:38:01.360+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34209 #520 (6 connections now open) 2015-06-13T02:38:14.188+0000 I NETWORK [conn519] end connection 10.3.1.100:58936 (5 connections now open) 2015-06-13T02:38:14.189+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58938 #521 (6 connections now open) 2015-06-13T02:38:18.169+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:38:18.024+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:38:31.371+0000 I NETWORK [conn520] end connection 10.3.1.102:34209 (5 connections now open) 2015-06-13T02:38:31.371+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34211 #522 (6 connections now open) 2015-06-13T02:38:44.204+0000 I NETWORK [conn521] end connection 10.3.1.100:58938 (5 connections now open) 2015-06-13T02:38:44.205+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58940 #523 (6 connections now open) 2015-06-13T02:38:48.316+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:38:48.169+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:39:01.382+0000 I NETWORK [conn522] end connection 10.3.1.102:34211 (5 connections now open) 2015-06-13T02:39:01.383+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34213 #524 (6 connections now open) 2015-06-13T02:39:14.218+0000 I NETWORK [conn523] end connection 10.3.1.100:58940 (5 connections now open) 2015-06-13T02:39:14.218+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58943 #525 (6 connections now open) 2015-06-13T02:39:18.460+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:39:18.316+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:39:31.398+0000 I NETWORK [conn524] end connection 10.3.1.102:34213 (5 connections now open) 2015-06-13T02:39:31.398+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34215 #526 (6 connections now open) 2015-06-13T02:39:44.228+0000 I NETWORK [conn525] end connection 10.3.1.100:58943 (5 connections now open) 2015-06-13T02:39:44.228+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58945 #527 (6 connections now open) 2015-06-13T02:39:48.604+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:39:48.460+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:40:01.408+0000 I NETWORK [conn526] end connection 10.3.1.102:34215 (5 connections now open) 2015-06-13T02:40:01.408+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34217 #528 (6 connections now open) 2015-06-13T02:40:14.238+0000 I NETWORK [conn527] end connection 10.3.1.100:58945 (5 connections now open) 2015-06-13T02:40:14.238+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58947 #529 (6 connections now open) 2015-06-13T02:40:18.751+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:40:18.605+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:40:31.422+0000 I NETWORK [conn528] end connection 10.3.1.102:34217 (5 connections now open) 2015-06-13T02:40:31.422+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34219 #530 (6 connections now open) 2015-06-13T02:40:44.249+0000 I NETWORK [conn529] end connection 10.3.1.100:58947 (5 connections now open) 2015-06-13T02:40:44.250+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58949 #531 (6 connections now open) 2015-06-13T02:40:48.966+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:40:48.751+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:41:01.436+0000 I NETWORK [conn530] end connection 10.3.1.102:34219 (5 connections now open) 2015-06-13T02:41:01.437+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34221 #532 (6 connections now open) 2015-06-13T02:41:14.263+0000 I NETWORK [conn531] end connection 10.3.1.100:58949 (5 connections now open) 2015-06-13T02:41:14.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58951 #533 (6 connections now open) 2015-06-13T02:41:19.214+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:41:18.966+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:41:31.452+0000 I NETWORK [conn532] end connection 10.3.1.102:34221 (5 connections now open) 2015-06-13T02:41:31.452+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34224 #534 (6 connections now open) 2015-06-13T02:41:44.274+0000 I NETWORK [conn533] end connection 10.3.1.100:58951 (5 connections now open) 2015-06-13T02:41:44.274+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58953 #535 (6 connections now open) 2015-06-13T02:41:49.460+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:41:49.214+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:42:01.464+0000 I NETWORK [conn534] end connection 10.3.1.102:34224 (5 connections now open) 2015-06-13T02:42:01.464+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34226 #536 (6 connections now open) 2015-06-13T02:42:14.284+0000 I NETWORK [conn535] end connection 10.3.1.100:58953 (5 connections now open) 2015-06-13T02:42:14.284+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58955 #537 (6 connections now open) 2015-06-13T02:42:19.708+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:42:19.460+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:42:31.483+0000 I NETWORK [conn536] end connection 10.3.1.102:34226 (5 connections now open) 2015-06-13T02:42:31.484+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34228 #538 (6 connections now open) 2015-06-13T02:42:44.296+0000 I NETWORK [conn537] end connection 10.3.1.100:58955 (5 connections now open) 2015-06-13T02:42:44.297+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58957 #539 (6 connections now open) 2015-06-13T02:42:49.988+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:42:49.709+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:43:01.496+0000 I NETWORK [conn538] end connection 10.3.1.102:34228 (5 connections now open) 2015-06-13T02:43:01.496+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34230 #540 (6 connections now open) 2015-06-13T02:43:14.310+0000 I NETWORK [conn539] end connection 10.3.1.100:58957 (5 connections now open) 2015-06-13T02:43:14.310+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58959 #541 (6 connections now open) 2015-06-13T02:43:20.235+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:43:19.988+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:43:31.509+0000 I NETWORK [conn540] end connection 10.3.1.102:34230 (5 connections now open) 2015-06-13T02:43:31.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34232 #542 (6 connections now open) 2015-06-13T02:43:44.322+0000 I NETWORK [conn541] end connection 10.3.1.100:58959 (5 connections now open) 2015-06-13T02:43:44.323+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58961 #543 (6 connections now open) 2015-06-13T02:43:50.583+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:43:50.235+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:44:01.522+0000 I NETWORK [conn542] end connection 10.3.1.102:34232 (5 connections now open) 2015-06-13T02:44:01.522+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34234 #544 (6 connections now open) 2015-06-13T02:44:14.335+0000 I NETWORK [conn543] end connection 10.3.1.100:58961 (5 connections now open) 2015-06-13T02:44:14.335+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58963 #545 (6 connections now open) 2015-06-13T02:44:20.728+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:44:20.583+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:44:31.535+0000 I NETWORK [conn544] end connection 10.3.1.102:34234 (5 connections now open) 2015-06-13T02:44:31.535+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34236 #546 (6 connections now open) 2015-06-13T02:44:44.345+0000 I NETWORK [conn545] end connection 10.3.1.100:58963 (5 connections now open) 2015-06-13T02:44:44.345+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58965 #547 (6 connections now open) 2015-06-13T02:44:50.974+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:44:50.728+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:45:01.548+0000 I NETWORK [conn546] end connection 10.3.1.102:34236 (5 connections now open) 2015-06-13T02:45:01.548+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34238 #548 (6 connections now open) 2015-06-13T02:45:14.357+0000 I NETWORK [conn547] end connection 10.3.1.100:58965 (5 connections now open) 2015-06-13T02:45:14.357+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58967 #549 (6 connections now open) 2015-06-13T02:45:21.223+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:45:20.974+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:45:31.560+0000 I NETWORK [conn548] end connection 10.3.1.102:34238 (5 connections now open) 2015-06-13T02:45:31.560+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34240 #550 (6 connections now open) 2015-06-13T02:45:44.368+0000 I NETWORK [conn549] end connection 10.3.1.100:58967 (5 connections now open) 2015-06-13T02:45:44.369+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58969 #551 (6 connections now open) 2015-06-13T02:45:51.469+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:45:51.223+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:46:01.576+0000 I NETWORK [conn550] end connection 10.3.1.102:34240 (5 connections now open) 2015-06-13T02:46:01.576+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34242 #552 (6 connections now open) 2015-06-13T02:46:14.380+0000 I NETWORK [conn551] end connection 10.3.1.100:58969 (5 connections now open) 2015-06-13T02:46:14.381+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58971 #553 (6 connections now open) 2015-06-13T02:46:21.718+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:46:21.469+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:46:31.588+0000 I NETWORK [conn552] end connection 10.3.1.102:34242 (5 connections now open) 2015-06-13T02:46:31.588+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34244 #554 (6 connections now open) 2015-06-13T02:46:44.391+0000 I NETWORK [conn553] end connection 10.3.1.100:58971 (5 connections now open) 2015-06-13T02:46:44.391+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58973 #555 (6 connections now open) 2015-06-13T02:46:51.969+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:46:51.719+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:47:01.601+0000 I NETWORK [conn554] end connection 10.3.1.102:34244 (5 connections now open) 2015-06-13T02:47:01.602+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34246 #556 (6 connections now open) 2015-06-13T02:47:14.402+0000 I NETWORK [conn555] end connection 10.3.1.100:58973 (5 connections now open) 2015-06-13T02:47:14.402+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58975 #557 (6 connections now open) 2015-06-13T02:47:22.253+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:47:21.969+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:47:31.617+0000 I NETWORK [conn556] end connection 10.3.1.102:34246 (5 connections now open) 2015-06-13T02:47:31.617+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34248 #558 (6 connections now open) 2015-06-13T02:47:44.414+0000 I NETWORK [conn557] end connection 10.3.1.100:58975 (5 connections now open) 2015-06-13T02:47:44.414+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58977 #559 (6 connections now open) 2015-06-13T02:47:52.414+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:47:52.254+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:48:01.634+0000 I NETWORK [conn558] end connection 10.3.1.102:34248 (5 connections now open) 2015-06-13T02:48:01.634+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34250 #560 (6 connections now open) 2015-06-13T02:48:14.423+0000 I NETWORK [conn559] end connection 10.3.1.100:58977 (5 connections now open) 2015-06-13T02:48:14.423+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58979 #561 (6 connections now open) 2015-06-13T02:48:22.561+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:48:22.415+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:48:31.647+0000 I NETWORK [conn560] end connection 10.3.1.102:34250 (5 connections now open) 2015-06-13T02:48:31.648+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34252 #562 (6 connections now open) 2015-06-13T02:48:44.432+0000 I NETWORK [conn561] end connection 10.3.1.100:58979 (5 connections now open) 2015-06-13T02:48:44.432+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58981 #563 (6 connections now open) 2015-06-13T02:48:52.704+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:48:52.561+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:49:01.661+0000 I NETWORK [conn562] end connection 10.3.1.102:34252 (5 connections now open) 2015-06-13T02:49:01.661+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34254 #564 (6 connections now open) 2015-06-13T02:49:14.442+0000 I NETWORK [conn563] end connection 10.3.1.100:58981 (5 connections now open) 2015-06-13T02:49:14.443+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58983 #565 (6 connections now open) 2015-06-13T02:49:22.847+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:49:22.704+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:49:31.672+0000 I NETWORK [conn564] end connection 10.3.1.102:34254 (5 connections now open) 2015-06-13T02:49:31.672+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34256 #566 (6 connections now open) 2015-06-13T02:49:44.452+0000 I NETWORK [conn565] end connection 10.3.1.100:58983 (5 connections now open) 2015-06-13T02:49:44.453+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58985 #567 (6 connections now open) 2015-06-13T02:49:52.993+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:49:52.848+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:50:01.686+0000 I NETWORK [conn566] end connection 10.3.1.102:34256 (5 connections now open) 2015-06-13T02:50:01.686+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34258 #568 (6 connections now open) 2015-06-13T02:50:14.462+0000 I NETWORK [conn567] end connection 10.3.1.100:58985 (5 connections now open) 2015-06-13T02:50:14.462+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58987 #569 (6 connections now open) 2015-06-13T02:50:23.172+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:50:22.993+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:50:31.698+0000 I NETWORK [conn568] end connection 10.3.1.102:34258 (5 connections now open) 2015-06-13T02:50:31.698+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34260 #570 (6 connections now open) 2015-06-13T02:50:44.475+0000 I NETWORK [conn569] end connection 10.3.1.100:58987 (5 connections now open) 2015-06-13T02:50:44.475+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58989 #571 (6 connections now open) 2015-06-13T02:50:53.353+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:50:53.172+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:51:01.707+0000 I NETWORK [conn570] end connection 10.3.1.102:34260 (5 connections now open) 2015-06-13T02:51:01.707+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34262 #572 (6 connections now open) 2015-06-13T02:51:14.482+0000 I NETWORK [conn571] end connection 10.3.1.100:58989 (5 connections now open) 2015-06-13T02:51:14.482+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58991 #573 (6 connections now open) 2015-06-13T02:51:23.604+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:51:23.354+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:51:31.720+0000 I NETWORK [conn572] end connection 10.3.1.102:34262 (5 connections now open) 2015-06-13T02:51:31.720+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34264 #574 (6 connections now open) 2015-06-13T02:51:44.493+0000 I NETWORK [conn573] end connection 10.3.1.100:58991 (5 connections now open) 2015-06-13T02:51:44.493+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58993 #575 (6 connections now open) 2015-06-13T02:51:53.850+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:51:53.604+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:52:01.733+0000 I NETWORK [conn574] end connection 10.3.1.102:34264 (5 connections now open) 2015-06-13T02:52:01.733+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34266 #576 (6 connections now open) 2015-06-13T02:52:14.501+0000 I NETWORK [conn575] end connection 10.3.1.100:58993 (5 connections now open) 2015-06-13T02:52:14.501+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58995 #577 (6 connections now open) 2015-06-13T02:52:24.096+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:52:23.850+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:52:31.744+0000 I NETWORK [conn576] end connection 10.3.1.102:34266 (5 connections now open) 2015-06-13T02:52:31.744+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34268 #578 (6 connections now open) 2015-06-13T02:52:44.515+0000 I NETWORK [conn577] end connection 10.3.1.100:58995 (5 connections now open) 2015-06-13T02:52:44.515+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58997 #579 (6 connections now open) 2015-06-13T02:52:54.346+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:52:54.097+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:53:01.753+0000 I NETWORK [conn578] end connection 10.3.1.102:34268 (5 connections now open) 2015-06-13T02:53:01.753+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34270 #580 (6 connections now open) 2015-06-13T02:53:14.529+0000 I NETWORK [conn579] end connection 10.3.1.100:58997 (5 connections now open) 2015-06-13T02:53:14.529+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:58999 #581 (6 connections now open) 2015-06-13T02:53:24.591+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:53:24.346+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:53:31.765+0000 I NETWORK [conn580] end connection 10.3.1.102:34270 (5 connections now open) 2015-06-13T02:53:31.766+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34272 #582 (6 connections now open) 2015-06-13T02:53:44.540+0000 I NETWORK [conn581] end connection 10.3.1.100:58999 (5 connections now open) 2015-06-13T02:53:44.541+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59001 #583 (6 connections now open) 2015-06-13T02:53:54.836+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:53:54.592+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:54:01.778+0000 I NETWORK [conn582] end connection 10.3.1.102:34272 (5 connections now open) 2015-06-13T02:54:01.778+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34274 #584 (6 connections now open) 2015-06-13T02:54:14.550+0000 I NETWORK [conn583] end connection 10.3.1.100:59001 (5 connections now open) 2015-06-13T02:54:14.550+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59003 #585 (6 connections now open) 2015-06-13T02:54:25.082+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:54:24.836+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:54:31.788+0000 I NETWORK [conn584] end connection 10.3.1.102:34274 (5 connections now open) 2015-06-13T02:54:31.788+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34276 #586 (6 connections now open) 2015-06-13T02:54:44.561+0000 I NETWORK [conn585] end connection 10.3.1.100:59003 (5 connections now open) 2015-06-13T02:54:44.561+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59005 #587 (6 connections now open) 2015-06-13T02:54:55.331+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:54:55.083+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:55:01.798+0000 I NETWORK [conn586] end connection 10.3.1.102:34276 (5 connections now open) 2015-06-13T02:55:01.799+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34278 #588 (6 connections now open) 2015-06-13T02:55:14.571+0000 I NETWORK [conn587] end connection 10.3.1.100:59005 (5 connections now open) 2015-06-13T02:55:14.571+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59007 #589 (6 connections now open) 2015-06-13T02:55:25.578+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:55:25.332+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:55:31.811+0000 I NETWORK [conn588] end connection 10.3.1.102:34278 (5 connections now open) 2015-06-13T02:55:31.811+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34280 #590 (6 connections now open) 2015-06-13T02:55:44.583+0000 I NETWORK [conn589] end connection 10.3.1.100:59007 (5 connections now open) 2015-06-13T02:55:44.584+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59009 #591 (6 connections now open) 2015-06-13T02:55:55.825+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:55:55.578+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:56:01.822+0000 I NETWORK [conn590] end connection 10.3.1.102:34280 (5 connections now open) 2015-06-13T02:56:01.823+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34282 #592 (6 connections now open) 2015-06-13T02:56:14.595+0000 I NETWORK [conn591] end connection 10.3.1.100:59009 (5 connections now open) 2015-06-13T02:56:14.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59011 #593 (6 connections now open) 2015-06-13T02:56:26.076+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:56:25.825+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:56:31.831+0000 I NETWORK [conn592] end connection 10.3.1.102:34282 (5 connections now open) 2015-06-13T02:56:31.831+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34284 #594 (6 connections now open) 2015-06-13T02:56:44.606+0000 I NETWORK [conn593] end connection 10.3.1.100:59011 (5 connections now open) 2015-06-13T02:56:44.606+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59013 #595 (6 connections now open) 2015-06-13T02:56:56.354+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:56:56.076+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:57:01.840+0000 I NETWORK [conn594] end connection 10.3.1.102:34284 (5 connections now open) 2015-06-13T02:57:01.840+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34286 #596 (6 connections now open) 2015-06-13T02:57:14.614+0000 I NETWORK [conn595] end connection 10.3.1.100:59013 (5 connections now open) 2015-06-13T02:57:14.615+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59015 #597 (6 connections now open) 2015-06-13T02:57:26.601+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:57:26.355+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:57:31.848+0000 I NETWORK [conn596] end connection 10.3.1.102:34286 (5 connections now open) 2015-06-13T02:57:31.849+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34288 #598 (6 connections now open) 2015-06-13T02:57:44.626+0000 I NETWORK [conn597] end connection 10.3.1.100:59015 (5 connections now open) 2015-06-13T02:57:44.626+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59017 #599 (6 connections now open) 2015-06-13T02:57:56.846+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:57:56.601+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:58:01.861+0000 I NETWORK [conn598] end connection 10.3.1.102:34288 (5 connections now open) 2015-06-13T02:58:01.861+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34290 #600 (6 connections now open) 2015-06-13T02:58:14.636+0000 I NETWORK [conn599] end connection 10.3.1.100:59017 (5 connections now open) 2015-06-13T02:58:14.636+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59019 #601 (6 connections now open) 2015-06-13T02:58:27.162+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:58:26.846+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:58:31.871+0000 I NETWORK [conn600] end connection 10.3.1.102:34290 (5 connections now open) 2015-06-13T02:58:31.871+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34292 #602 (6 connections now open) 2015-06-13T02:58:44.649+0000 I NETWORK [conn601] end connection 10.3.1.100:59019 (5 connections now open) 2015-06-13T02:58:44.649+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59021 #603 (6 connections now open) 2015-06-13T02:58:57.408+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:58:57.162+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:59:01.882+0000 I NETWORK [conn602] end connection 10.3.1.102:34292 (5 connections now open) 2015-06-13T02:59:01.882+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34294 #604 (6 connections now open) 2015-06-13T02:59:14.660+0000 I NETWORK [conn603] end connection 10.3.1.100:59021 (5 connections now open) 2015-06-13T02:59:14.660+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59023 #605 (6 connections now open) 2015-06-13T02:59:27.586+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:59:27.408+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T02:59:31.893+0000 I NETWORK [conn604] end connection 10.3.1.102:34294 (5 connections now open) 2015-06-13T02:59:31.893+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34296 #606 (6 connections now open) 2015-06-13T02:59:44.675+0000 I NETWORK [conn605] end connection 10.3.1.100:59023 (5 connections now open) 2015-06-13T02:59:44.675+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59025 #607 (6 connections now open) 2015-06-13T02:59:57.835+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T02:59:57.586+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:00:01.900+0000 I NETWORK [conn606] end connection 10.3.1.102:34296 (5 connections now open) 2015-06-13T03:00:01.900+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34298 #608 (6 connections now open) 2015-06-13T03:00:14.686+0000 I NETWORK [conn607] end connection 10.3.1.100:59025 (5 connections now open) 2015-06-13T03:00:14.686+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59027 #609 (6 connections now open) 2015-06-13T03:00:28.084+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:00:27.836+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:00:31.910+0000 I NETWORK [conn608] end connection 10.3.1.102:34298 (5 connections now open) 2015-06-13T03:00:31.910+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34300 #610 (6 connections now open) 2015-06-13T03:00:44.698+0000 I NETWORK [conn609] end connection 10.3.1.100:59027 (5 connections now open) 2015-06-13T03:00:44.698+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59029 #611 (6 connections now open) 2015-06-13T03:00:58.329+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:00:58.085+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:01:01.920+0000 I NETWORK [conn610] end connection 10.3.1.102:34300 (5 connections now open) 2015-06-13T03:01:01.920+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34302 #612 (6 connections now open) 2015-06-13T03:01:14.707+0000 I NETWORK [conn611] end connection 10.3.1.100:59029 (5 connections now open) 2015-06-13T03:01:14.708+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59031 #613 (6 connections now open) 2015-06-13T03:01:28.580+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:01:28.329+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:01:31.929+0000 I NETWORK [conn612] end connection 10.3.1.102:34302 (5 connections now open) 2015-06-13T03:01:31.930+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34304 #614 (6 connections now open) 2015-06-13T03:01:44.719+0000 I NETWORK [conn613] end connection 10.3.1.100:59031 (5 connections now open) 2015-06-13T03:01:44.719+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59033 #615 (6 connections now open) 2015-06-13T03:01:58.827+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:01:58.580+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:02:01.938+0000 I NETWORK [conn614] end connection 10.3.1.102:34304 (5 connections now open) 2015-06-13T03:02:01.938+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34306 #616 (6 connections now open) 2015-06-13T03:02:14.732+0000 I NETWORK [conn615] end connection 10.3.1.100:59033 (5 connections now open) 2015-06-13T03:02:14.733+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59035 #617 (6 connections now open) 2015-06-13T03:02:29.074+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:02:28.827+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:02:31.948+0000 I NETWORK [conn616] end connection 10.3.1.102:34306 (5 connections now open) 2015-06-13T03:02:31.948+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34308 #618 (6 connections now open) 2015-06-13T03:02:44.742+0000 I NETWORK [conn617] end connection 10.3.1.100:59035 (5 connections now open) 2015-06-13T03:02:44.742+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59037 #619 (6 connections now open) 2015-06-13T03:02:59.321+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:02:59.074+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:03:01.957+0000 I NETWORK [conn618] end connection 10.3.1.102:34308 (5 connections now open) 2015-06-13T03:03:01.957+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34310 #620 (6 connections now open) 2015-06-13T03:03:14.753+0000 I NETWORK [conn619] end connection 10.3.1.100:59037 (5 connections now open) 2015-06-13T03:03:14.753+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59039 #621 (6 connections now open) 2015-06-13T03:03:29.568+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:03:29.322+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:03:31.966+0000 I NETWORK [conn620] end connection 10.3.1.102:34310 (5 connections now open) 2015-06-13T03:03:31.966+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34312 #622 (6 connections now open) 2015-06-13T03:03:44.763+0000 I NETWORK [conn621] end connection 10.3.1.100:59039 (5 connections now open) 2015-06-13T03:03:44.764+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59041 #623 (6 connections now open) 2015-06-13T03:03:59.812+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:03:59.568+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:04:01.978+0000 I NETWORK [conn622] end connection 10.3.1.102:34312 (5 connections now open) 2015-06-13T03:04:01.979+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34314 #624 (6 connections now open) 2015-06-13T03:04:14.774+0000 I NETWORK [conn623] end connection 10.3.1.100:59041 (5 connections now open) 2015-06-13T03:04:14.774+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59043 #625 (6 connections now open) 2015-06-13T03:04:29.989+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:04:29.812+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:04:31.990+0000 I NETWORK [conn624] end connection 10.3.1.102:34314 (5 connections now open) 2015-06-13T03:04:31.991+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34316 #626 (6 connections now open) 2015-06-13T03:04:44.785+0000 I NETWORK [conn625] end connection 10.3.1.100:59043 (5 connections now open) 2015-06-13T03:04:44.785+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59045 #627 (6 connections now open) 2015-06-13T03:05:00.170+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:04:59.989+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:05:01.999+0000 I NETWORK [conn626] end connection 10.3.1.102:34316 (5 connections now open) 2015-06-13T03:05:01.999+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34318 #628 (6 connections now open) 2015-06-13T03:05:14.796+0000 I NETWORK [conn627] end connection 10.3.1.100:59045 (5 connections now open) 2015-06-13T03:05:14.796+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59047 #629 (6 connections now open) 2015-06-13T03:05:30.348+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:05:30.170+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:05:32.010+0000 I NETWORK [conn628] end connection 10.3.1.102:34318 (5 connections now open) 2015-06-13T03:05:32.010+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34320 #630 (6 connections now open) 2015-06-13T03:05:44.806+0000 I NETWORK [conn629] end connection 10.3.1.100:59047 (5 connections now open) 2015-06-13T03:05:44.807+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59049 #631 (6 connections now open) 2015-06-13T03:06:00.526+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:06:00.348+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:06:02.020+0000 I NETWORK [conn630] end connection 10.3.1.102:34320 (5 connections now open) 2015-06-13T03:06:02.020+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34322 #632 (6 connections now open) 2015-06-13T03:06:14.817+0000 I NETWORK [conn631] end connection 10.3.1.100:59049 (5 connections now open) 2015-06-13T03:06:14.817+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59051 #633 (6 connections now open) 2015-06-13T03:06:30.707+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:06:30.527+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:06:32.029+0000 I NETWORK [conn632] end connection 10.3.1.102:34322 (5 connections now open) 2015-06-13T03:06:32.030+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34324 #634 (6 connections now open) 2015-06-13T03:06:44.829+0000 I NETWORK [conn633] end connection 10.3.1.100:59051 (5 connections now open) 2015-06-13T03:06:44.829+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59053 #635 (6 connections now open) 2015-06-13T03:07:00.989+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:07:00.708+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:07:02.039+0000 I NETWORK [conn634] end connection 10.3.1.102:34324 (5 connections now open) 2015-06-13T03:07:02.039+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34326 #636 (6 connections now open) 2015-06-13T03:07:14.841+0000 I NETWORK [conn635] end connection 10.3.1.100:59053 (5 connections now open) 2015-06-13T03:07:14.841+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59055 #637 (6 connections now open) 2015-06-13T03:07:31.270+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:07:30.989+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:07:32.052+0000 I NETWORK [conn636] end connection 10.3.1.102:34326 (5 connections now open) 2015-06-13T03:07:32.053+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34328 #638 (6 connections now open) 2015-06-13T03:07:44.853+0000 I NETWORK [conn637] end connection 10.3.1.100:59055 (5 connections now open) 2015-06-13T03:07:44.853+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59057 #639 (6 connections now open) 2015-06-13T03:08:01.484+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:08:01.270+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:08:02.062+0000 I NETWORK [conn638] end connection 10.3.1.102:34328 (5 connections now open) 2015-06-13T03:08:02.062+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34331 #640 (6 connections now open) 2015-06-13T03:08:14.864+0000 I NETWORK [conn639] end connection 10.3.1.100:59057 (5 connections now open) 2015-06-13T03:08:14.864+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59059 #641 (6 connections now open) 2015-06-13T03:08:31.662+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:08:31.484+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:08:32.072+0000 I NETWORK [conn640] end connection 10.3.1.102:34331 (5 connections now open) 2015-06-13T03:08:32.073+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34333 #642 (6 connections now open) 2015-06-13T03:08:44.874+0000 I NETWORK [conn641] end connection 10.3.1.100:59059 (5 connections now open) 2015-06-13T03:08:44.874+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59062 #643 (6 connections now open) 2015-06-13T03:09:01.805+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:09:01.662+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:09:02.081+0000 I NETWORK [conn642] end connection 10.3.1.102:34333 (5 connections now open) 2015-06-13T03:09:02.081+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34335 #644 (6 connections now open) 2015-06-13T03:09:14.883+0000 I NETWORK [conn643] end connection 10.3.1.100:59062 (5 connections now open) 2015-06-13T03:09:14.883+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59064 #645 (6 connections now open) 2015-06-13T03:09:31.982+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:09:31.805+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:09:32.096+0000 I NETWORK [conn644] end connection 10.3.1.102:34335 (5 connections now open) 2015-06-13T03:09:32.097+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34337 #646 (6 connections now open) 2015-06-13T03:09:44.893+0000 I NETWORK [conn645] end connection 10.3.1.100:59064 (5 connections now open) 2015-06-13T03:09:44.893+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59066 #647 (6 connections now open) 2015-06-13T03:10:02.105+0000 I NETWORK [conn646] end connection 10.3.1.102:34337 (5 connections now open) 2015-06-13T03:10:02.106+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34339 #648 (6 connections now open) 2015-06-13T03:10:02.164+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:10:01.982+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:10:14.906+0000 I NETWORK [conn647] end connection 10.3.1.100:59066 (5 connections now open) 2015-06-13T03:10:14.906+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59068 #649 (6 connections now open) 2015-06-13T03:10:32.115+0000 I NETWORK [conn648] end connection 10.3.1.102:34339 (5 connections now open) 2015-06-13T03:10:32.116+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34341 #650 (6 connections now open) 2015-06-13T03:10:32.308+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:10:32.164+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:10:44.918+0000 I NETWORK [conn649] end connection 10.3.1.100:59068 (5 connections now open) 2015-06-13T03:10:44.918+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59070 #651 (6 connections now open) 2015-06-13T03:11:02.124+0000 I NETWORK [conn650] end connection 10.3.1.102:34341 (5 connections now open) 2015-06-13T03:11:02.124+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34343 #652 (6 connections now open) 2015-06-13T03:11:02.452+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:11:02.308+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:11:14.929+0000 I NETWORK [conn651] end connection 10.3.1.100:59070 (5 connections now open) 2015-06-13T03:11:14.929+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59072 #653 (6 connections now open) 2015-06-13T03:11:32.134+0000 I NETWORK [conn652] end connection 10.3.1.102:34343 (5 connections now open) 2015-06-13T03:11:32.134+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34345 #654 (6 connections now open) 2015-06-13T03:11:32.596+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:11:32.452+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:11:44.939+0000 I NETWORK [conn653] end connection 10.3.1.100:59072 (5 connections now open) 2015-06-13T03:11:44.939+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59074 #655 (6 connections now open) 2015-06-13T03:12:02.144+0000 I NETWORK [conn654] end connection 10.3.1.102:34345 (5 connections now open) 2015-06-13T03:12:02.144+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34347 #656 (6 connections now open) 2015-06-13T03:12:02.745+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:12:02.596+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:12:14.954+0000 I NETWORK [conn655] end connection 10.3.1.100:59074 (5 connections now open) 2015-06-13T03:12:14.954+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59076 #657 (6 connections now open) 2015-06-13T03:12:32.156+0000 I NETWORK [conn656] end connection 10.3.1.102:34347 (5 connections now open) 2015-06-13T03:12:32.156+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34349 #658 (6 connections now open) 2015-06-13T03:12:32.891+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:12:32.745+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:12:44.966+0000 I NETWORK [conn657] end connection 10.3.1.100:59076 (5 connections now open) 2015-06-13T03:12:44.966+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59078 #659 (6 connections now open) 2015-06-13T03:13:02.168+0000 I NETWORK [conn658] end connection 10.3.1.102:34349 (5 connections now open) 2015-06-13T03:13:02.169+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34351 #660 (6 connections now open) 2015-06-13T03:13:03.036+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:13:02.891+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:13:14.976+0000 I NETWORK [conn659] end connection 10.3.1.100:59078 (5 connections now open) 2015-06-13T03:13:14.976+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59080 #661 (6 connections now open) 2015-06-13T03:13:32.178+0000 I NETWORK [conn660] end connection 10.3.1.102:34351 (5 connections now open) 2015-06-13T03:13:32.180+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34353 #662 (6 connections now open) 2015-06-13T03:13:33.182+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:13:33.036+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:13:44.985+0000 I NETWORK [conn661] end connection 10.3.1.100:59080 (5 connections now open) 2015-06-13T03:13:44.985+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59082 #663 (6 connections now open) 2015-06-13T03:14:02.189+0000 I NETWORK [conn662] end connection 10.3.1.102:34353 (5 connections now open) 2015-06-13T03:14:02.189+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34355 #664 (6 connections now open) 2015-06-13T03:14:03.326+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:14:03.183+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:14:14.994+0000 I NETWORK [conn663] end connection 10.3.1.100:59082 (5 connections now open) 2015-06-13T03:14:14.995+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59084 #665 (6 connections now open) 2015-06-13T03:14:32.199+0000 I NETWORK [conn664] end connection 10.3.1.102:34355 (5 connections now open) 2015-06-13T03:14:32.199+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34357 #666 (6 connections now open) 2015-06-13T03:14:33.470+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:14:33.326+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:14:45.007+0000 I NETWORK [conn665] end connection 10.3.1.100:59084 (5 connections now open) 2015-06-13T03:14:45.007+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59086 #667 (6 connections now open) 2015-06-13T03:15:02.209+0000 I NETWORK [conn666] end connection 10.3.1.102:34357 (5 connections now open) 2015-06-13T03:15:02.209+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34359 #668 (6 connections now open) 2015-06-13T03:15:03.617+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:15:03.470+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:15:15.019+0000 I NETWORK [conn667] end connection 10.3.1.100:59086 (5 connections now open) 2015-06-13T03:15:15.019+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59088 #669 (6 connections now open) 2015-06-13T03:15:32.219+0000 I NETWORK [conn668] end connection 10.3.1.102:34359 (5 connections now open) 2015-06-13T03:15:32.219+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34361 #670 (6 connections now open) 2015-06-13T03:15:33.897+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:15:33.617+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:15:45.032+0000 I NETWORK [conn669] end connection 10.3.1.100:59088 (5 connections now open) 2015-06-13T03:15:45.032+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59090 #671 (6 connections now open) 2015-06-13T03:16:02.228+0000 I NETWORK [conn670] end connection 10.3.1.102:34361 (5 connections now open) 2015-06-13T03:16:02.228+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34363 #672 (6 connections now open) 2015-06-13T03:16:04.177+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:16:03.897+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:16:15.044+0000 I NETWORK [conn671] end connection 10.3.1.100:59090 (5 connections now open) 2015-06-13T03:16:15.045+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59092 #673 (6 connections now open) 2015-06-13T03:16:32.233+0000 I NETWORK [conn672] end connection 10.3.1.102:34363 (5 connections now open) 2015-06-13T03:16:32.233+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34365 #674 (6 connections now open) 2015-06-13T03:16:34.354+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:16:34.177+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:16:45.055+0000 I NETWORK [conn673] end connection 10.3.1.100:59092 (5 connections now open) 2015-06-13T03:16:45.055+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59094 #675 (6 connections now open) 2015-06-13T03:17:02.244+0000 I NETWORK [conn674] end connection 10.3.1.102:34365 (5 connections now open) 2015-06-13T03:17:02.244+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34367 #676 (6 connections now open) 2015-06-13T03:17:04.638+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:17:04.354+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:17:15.066+0000 I NETWORK [conn675] end connection 10.3.1.100:59094 (5 connections now open) 2015-06-13T03:17:15.066+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59096 #677 (6 connections now open) 2015-06-13T03:17:32.255+0000 I NETWORK [conn676] end connection 10.3.1.102:34367 (5 connections now open) 2015-06-13T03:17:32.255+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34369 #678 (6 connections now open) 2015-06-13T03:17:34.890+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:17:34.639+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:17:45.076+0000 I NETWORK [conn677] end connection 10.3.1.100:59096 (5 connections now open) 2015-06-13T03:17:45.076+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59098 #679 (6 connections now open) 2015-06-13T03:18:02.268+0000 I NETWORK [conn678] end connection 10.3.1.102:34369 (5 connections now open) 2015-06-13T03:18:02.268+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34371 #680 (6 connections now open) 2015-06-13T03:18:05.139+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:18:04.890+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:18:15.089+0000 I NETWORK [conn679] end connection 10.3.1.100:59098 (5 connections now open) 2015-06-13T03:18:15.090+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59100 #681 (6 connections now open) 2015-06-13T03:18:32.277+0000 I NETWORK [conn680] end connection 10.3.1.102:34371 (5 connections now open) 2015-06-13T03:18:32.278+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34373 #682 (6 connections now open) 2015-06-13T03:18:35.425+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:18:35.140+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:18:45.099+0000 I NETWORK [conn681] end connection 10.3.1.100:59100 (5 connections now open) 2015-06-13T03:18:45.100+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59102 #683 (6 connections now open) 2015-06-13T03:19:02.286+0000 I NETWORK [conn682] end connection 10.3.1.102:34373 (5 connections now open) 2015-06-13T03:19:02.287+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34375 #684 (6 connections now open) 2015-06-13T03:19:05.706+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:19:05.425+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:19:15.108+0000 I NETWORK [conn683] end connection 10.3.1.100:59102 (5 connections now open) 2015-06-13T03:19:15.108+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59104 #685 (6 connections now open) 2015-06-13T03:19:32.297+0000 I NETWORK [conn684] end connection 10.3.1.102:34375 (5 connections now open) 2015-06-13T03:19:32.298+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34377 #686 (6 connections now open) 2015-06-13T03:19:35.986+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:19:35.706+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:19:45.119+0000 I NETWORK [conn685] end connection 10.3.1.100:59104 (5 connections now open) 2015-06-13T03:19:45.119+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59106 #687 (6 connections now open) 2015-06-13T03:20:02.307+0000 I NETWORK [conn686] end connection 10.3.1.102:34377 (5 connections now open) 2015-06-13T03:20:02.307+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34379 #688 (6 connections now open) 2015-06-13T03:20:06.267+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:20:05.986+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:20:15.127+0000 I NETWORK [conn687] end connection 10.3.1.100:59106 (5 connections now open) 2015-06-13T03:20:15.127+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59108 #689 (6 connections now open) 2015-06-13T03:20:32.317+0000 I NETWORK [conn688] end connection 10.3.1.102:34379 (5 connections now open) 2015-06-13T03:20:32.317+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34381 #690 (6 connections now open) 2015-06-13T03:20:36.514+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:20:36.267+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:20:45.136+0000 I NETWORK [conn689] end connection 10.3.1.100:59108 (5 connections now open) 2015-06-13T03:20:45.137+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59110 #691 (6 connections now open) 2015-06-13T03:21:02.327+0000 I NETWORK [conn690] end connection 10.3.1.102:34381 (5 connections now open) 2015-06-13T03:21:02.328+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34383 #692 (6 connections now open) 2015-06-13T03:21:06.793+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:21:06.515+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:21:15.148+0000 I NETWORK [conn691] end connection 10.3.1.100:59110 (5 connections now open) 2015-06-13T03:21:15.148+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59112 #693 (6 connections now open) 2015-06-13T03:21:32.339+0000 I NETWORK [conn692] end connection 10.3.1.102:34383 (5 connections now open) 2015-06-13T03:21:32.339+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34385 #694 (6 connections now open) 2015-06-13T03:21:37.038+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:21:36.793+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:21:45.158+0000 I NETWORK [conn693] end connection 10.3.1.100:59112 (5 connections now open) 2015-06-13T03:21:45.159+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59114 #695 (6 connections now open) 2015-06-13T03:22:02.351+0000 I NETWORK [conn694] end connection 10.3.1.102:34385 (5 connections now open) 2015-06-13T03:22:02.352+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34387 #696 (6 connections now open) 2015-06-13T03:22:07.288+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:22:07.039+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:22:15.170+0000 I NETWORK [conn695] end connection 10.3.1.100:59114 (5 connections now open) 2015-06-13T03:22:15.170+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59116 #697 (6 connections now open) 2015-06-13T03:22:32.360+0000 I NETWORK [conn696] end connection 10.3.1.102:34387 (5 connections now open) 2015-06-13T03:22:32.361+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34389 #698 (6 connections now open) 2015-06-13T03:22:37.533+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:22:37.288+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:22:45.183+0000 I NETWORK [conn697] end connection 10.3.1.100:59116 (5 connections now open) 2015-06-13T03:22:45.183+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59118 #699 (6 connections now open) 2015-06-13T03:23:02.371+0000 I NETWORK [conn698] end connection 10.3.1.102:34389 (5 connections now open) 2015-06-13T03:23:02.371+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34391 #700 (6 connections now open) 2015-06-13T03:23:07.782+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:23:07.533+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:23:15.196+0000 I NETWORK [conn699] end connection 10.3.1.100:59118 (5 connections now open) 2015-06-13T03:23:15.197+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59120 #701 (6 connections now open) 2015-06-13T03:23:32.379+0000 I NETWORK [conn700] end connection 10.3.1.102:34391 (5 connections now open) 2015-06-13T03:23:32.379+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34393 #702 (6 connections now open) 2015-06-13T03:23:38.032+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:23:37.782+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:23:45.204+0000 I NETWORK [conn701] end connection 10.3.1.100:59120 (5 connections now open) 2015-06-13T03:23:45.204+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59122 #703 (6 connections now open) 2015-06-13T03:24:02.389+0000 I NETWORK [conn702] end connection 10.3.1.102:34393 (5 connections now open) 2015-06-13T03:24:02.389+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34398 #704 (6 connections now open) 2015-06-13T03:24:08.280+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:24:08.033+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:24:15.213+0000 I NETWORK [conn703] end connection 10.3.1.100:59122 (5 connections now open) 2015-06-13T03:24:15.213+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59124 #705 (6 connections now open) 2015-06-13T03:24:32.400+0000 I NETWORK [conn704] end connection 10.3.1.102:34398 (5 connections now open) 2015-06-13T03:24:32.400+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34400 #706 (6 connections now open) 2015-06-13T03:24:38.527+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:24:38.281+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:24:45.225+0000 I NETWORK [conn705] end connection 10.3.1.100:59124 (5 connections now open) 2015-06-13T03:24:45.225+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59126 #707 (6 connections now open) 2015-06-13T03:25:02.410+0000 I NETWORK [conn706] end connection 10.3.1.102:34400 (5 connections now open) 2015-06-13T03:25:02.410+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34402 #708 (6 connections now open) 2015-06-13T03:25:08.773+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:25:08.527+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:25:15.237+0000 I NETWORK [conn707] end connection 10.3.1.100:59126 (5 connections now open) 2015-06-13T03:25:15.237+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59128 #709 (6 connections now open) 2015-06-13T03:25:32.421+0000 I NETWORK [conn708] end connection 10.3.1.102:34402 (5 connections now open) 2015-06-13T03:25:32.422+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34404 #710 (6 connections now open) 2015-06-13T03:25:38.987+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:25:38.774+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:25:45.250+0000 I NETWORK [conn709] end connection 10.3.1.100:59128 (5 connections now open) 2015-06-13T03:25:45.250+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59130 #711 (6 connections now open) 2015-06-13T03:26:02.433+0000 I NETWORK [conn710] end connection 10.3.1.102:34404 (5 connections now open) 2015-06-13T03:26:02.433+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34406 #712 (6 connections now open) 2015-06-13T03:26:09.267+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:26:08.988+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:26:15.263+0000 I NETWORK [conn711] end connection 10.3.1.100:59130 (5 connections now open) 2015-06-13T03:26:15.263+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59132 #713 (6 connections now open) 2015-06-13T03:26:32.442+0000 I NETWORK [conn712] end connection 10.3.1.102:34406 (5 connections now open) 2015-06-13T03:26:32.443+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34408 #714 (6 connections now open) 2015-06-13T03:26:39.547+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:26:39.267+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:26:45.270+0000 I NETWORK [conn713] end connection 10.3.1.100:59132 (5 connections now open) 2015-06-13T03:26:45.270+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59134 #715 (6 connections now open) 2015-06-13T03:27:02.449+0000 I NETWORK [conn714] end connection 10.3.1.102:34408 (5 connections now open) 2015-06-13T03:27:02.449+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34410 #716 (6 connections now open) 2015-06-13T03:27:09.766+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:27:09.547+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:27:15.280+0000 I NETWORK [conn715] end connection 10.3.1.100:59134 (5 connections now open) 2015-06-13T03:27:15.280+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59136 #717 (6 connections now open) 2015-06-13T03:27:32.459+0000 I NETWORK [conn716] end connection 10.3.1.102:34410 (5 connections now open) 2015-06-13T03:27:32.459+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34412 #718 (6 connections now open) 2015-06-13T03:27:40.015+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:27:39.766+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:27:45.289+0000 I NETWORK [conn717] end connection 10.3.1.100:59136 (5 connections now open) 2015-06-13T03:27:45.289+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59138 #719 (6 connections now open) 2015-06-13T03:28:02.468+0000 I NETWORK [conn718] end connection 10.3.1.102:34412 (5 connections now open) 2015-06-13T03:28:02.469+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34414 #720 (6 connections now open) 2015-06-13T03:28:10.279+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:28:10.015+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:28:15.300+0000 I NETWORK [conn719] end connection 10.3.1.100:59138 (5 connections now open) 2015-06-13T03:28:15.300+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59140 #721 (6 connections now open) 2015-06-13T03:28:32.484+0000 I NETWORK [conn720] end connection 10.3.1.102:34414 (5 connections now open) 2015-06-13T03:28:32.484+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34416 #722 (6 connections now open) 2015-06-13T03:28:40.563+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:28:40.279+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:28:45.311+0000 I NETWORK [conn721] end connection 10.3.1.100:59140 (5 connections now open) 2015-06-13T03:28:45.312+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59142 #723 (6 connections now open) 2015-06-13T03:29:02.494+0000 I NETWORK [conn722] end connection 10.3.1.102:34416 (5 connections now open) 2015-06-13T03:29:02.494+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34418 #724 (6 connections now open) 2015-06-13T03:29:10.843+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:29:10.564+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:29:15.323+0000 I NETWORK [conn723] end connection 10.3.1.100:59142 (5 connections now open) 2015-06-13T03:29:15.323+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59144 #725 (6 connections now open) 2015-06-13T03:29:32.503+0000 I NETWORK [conn724] end connection 10.3.1.102:34418 (5 connections now open) 2015-06-13T03:29:32.503+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34420 #726 (6 connections now open) 2015-06-13T03:29:41.124+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:29:40.844+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:29:45.336+0000 I NETWORK [conn725] end connection 10.3.1.100:59144 (5 connections now open) 2015-06-13T03:29:45.336+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59146 #727 (6 connections now open) 2015-06-13T03:30:02.513+0000 I NETWORK [conn726] end connection 10.3.1.102:34420 (5 connections now open) 2015-06-13T03:30:02.513+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34422 #728 (6 connections now open) 2015-06-13T03:30:11.405+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:30:11.124+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:30:15.346+0000 I NETWORK [conn727] end connection 10.3.1.100:59146 (5 connections now open) 2015-06-13T03:30:15.346+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59148 #729 (6 connections now open) 2015-06-13T03:30:32.523+0000 I NETWORK [conn728] end connection 10.3.1.102:34422 (5 connections now open) 2015-06-13T03:30:32.524+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34424 #730 (6 connections now open) 2015-06-13T03:30:41.621+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:30:41.406+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:30:45.356+0000 I NETWORK [conn729] end connection 10.3.1.100:59148 (5 connections now open) 2015-06-13T03:30:45.356+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59150 #731 (6 connections now open) 2015-06-13T03:31:02.532+0000 I NETWORK [conn730] end connection 10.3.1.102:34424 (5 connections now open) 2015-06-13T03:31:02.533+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34426 #732 (6 connections now open) 2015-06-13T03:31:11.765+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:31:11.621+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:31:15.365+0000 I NETWORK [conn731] end connection 10.3.1.100:59150 (5 connections now open) 2015-06-13T03:31:15.366+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59152 #733 (6 connections now open) 2015-06-13T03:31:32.544+0000 I NETWORK [conn732] end connection 10.3.1.102:34426 (5 connections now open) 2015-06-13T03:31:32.544+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34428 #734 (6 connections now open) 2015-06-13T03:31:41.909+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:31:41.765+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:31:45.376+0000 I NETWORK [conn733] end connection 10.3.1.100:59152 (5 connections now open) 2015-06-13T03:31:45.376+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59154 #735 (6 connections now open) 2015-06-13T03:32:02.553+0000 I NETWORK [conn734] end connection 10.3.1.102:34428 (5 connections now open) 2015-06-13T03:32:02.553+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34430 #736 (6 connections now open) 2015-06-13T03:32:12.161+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:32:11.909+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:32:15.390+0000 I NETWORK [conn735] end connection 10.3.1.100:59154 (5 connections now open) 2015-06-13T03:32:15.390+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59156 #737 (6 connections now open) 2015-06-13T03:32:32.563+0000 I NETWORK [conn736] end connection 10.3.1.102:34430 (5 connections now open) 2015-06-13T03:32:32.564+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34433 #738 (6 connections now open) 2015-06-13T03:32:42.339+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:32:42.161+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:32:45.402+0000 I NETWORK [conn737] end connection 10.3.1.100:59156 (5 connections now open) 2015-06-13T03:32:45.402+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59158 #739 (6 connections now open) 2015-06-13T03:33:02.573+0000 I NETWORK [conn738] end connection 10.3.1.102:34433 (5 connections now open) 2015-06-13T03:33:02.573+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34435 #740 (6 connections now open) 2015-06-13T03:33:12.586+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:33:12.339+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:33:15.411+0000 I NETWORK [conn739] end connection 10.3.1.100:59158 (5 connections now open) 2015-06-13T03:33:15.411+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59160 #741 (6 connections now open) 2015-06-13T03:33:32.584+0000 I NETWORK [conn740] end connection 10.3.1.102:34435 (5 connections now open) 2015-06-13T03:33:32.584+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34437 #742 (6 connections now open) 2015-06-13T03:33:42.835+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:33:42.586+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:33:45.422+0000 I NETWORK [conn741] end connection 10.3.1.100:59160 (5 connections now open) 2015-06-13T03:33:45.422+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59162 #743 (6 connections now open) 2015-06-13T03:34:02.595+0000 I NETWORK [conn742] end connection 10.3.1.102:34437 (5 connections now open) 2015-06-13T03:34:02.595+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34439 #744 (6 connections now open) 2015-06-13T03:34:13.085+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:34:12.835+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:34:15.435+0000 I NETWORK [conn743] end connection 10.3.1.100:59162 (5 connections now open) 2015-06-13T03:34:15.435+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59164 #745 (6 connections now open) 2015-06-13T03:34:32.607+0000 I NETWORK [conn744] end connection 10.3.1.102:34439 (5 connections now open) 2015-06-13T03:34:32.608+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34441 #746 (6 connections now open) 2015-06-13T03:34:43.332+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:34:43.085+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:34:45.446+0000 I NETWORK [conn745] end connection 10.3.1.100:59164 (5 connections now open) 2015-06-13T03:34:45.446+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59166 #747 (6 connections now open) 2015-06-13T03:35:02.617+0000 I NETWORK [conn746] end connection 10.3.1.102:34441 (5 connections now open) 2015-06-13T03:35:02.618+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34443 #748 (6 connections now open) 2015-06-13T03:35:13.614+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:35:13.332+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:35:15.455+0000 I NETWORK [conn747] end connection 10.3.1.100:59166 (5 connections now open) 2015-06-13T03:35:15.455+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59168 #749 (6 connections now open) 2015-06-13T03:35:32.628+0000 I NETWORK [conn748] end connection 10.3.1.102:34443 (5 connections now open) 2015-06-13T03:35:32.628+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34445 #750 (6 connections now open) 2015-06-13T03:35:43.895+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:35:43.614+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:35:45.466+0000 I NETWORK [conn749] end connection 10.3.1.100:59168 (5 connections now open) 2015-06-13T03:35:45.467+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59170 #751 (6 connections now open) 2015-06-13T03:36:02.640+0000 I NETWORK [conn750] end connection 10.3.1.102:34445 (5 connections now open) 2015-06-13T03:36:02.641+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34447 #752 (6 connections now open) 2015-06-13T03:36:14.178+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:36:13.895+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:36:15.478+0000 I NETWORK [conn751] end connection 10.3.1.100:59170 (5 connections now open) 2015-06-13T03:36:15.479+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59172 #753 (6 connections now open) 2015-06-13T03:36:32.653+0000 I NETWORK [conn752] end connection 10.3.1.102:34447 (5 connections now open) 2015-06-13T03:36:32.653+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34449 #754 (6 connections now open) 2015-06-13T03:36:44.459+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:36:44.178+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:36:45.489+0000 I NETWORK [conn753] end connection 10.3.1.100:59172 (5 connections now open) 2015-06-13T03:36:45.489+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59174 #755 (6 connections now open) 2015-06-13T03:37:02.663+0000 I NETWORK [conn754] end connection 10.3.1.102:34449 (5 connections now open) 2015-06-13T03:37:02.664+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34451 #756 (6 connections now open) 2015-06-13T03:37:14.741+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:37:14.459+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:37:15.499+0000 I NETWORK [conn755] end connection 10.3.1.100:59174 (5 connections now open) 2015-06-13T03:37:15.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59176 #757 (6 connections now open) 2015-06-13T03:37:32.675+0000 I NETWORK [conn756] end connection 10.3.1.102:34451 (5 connections now open) 2015-06-13T03:37:32.676+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34453 #758 (6 connections now open) 2015-06-13T03:37:44.885+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:37:44.741+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:37:45.509+0000 I NETWORK [conn757] end connection 10.3.1.100:59176 (5 connections now open) 2015-06-13T03:37:45.509+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59178 #759 (6 connections now open) 2015-06-13T03:38:02.685+0000 I NETWORK [conn758] end connection 10.3.1.102:34453 (5 connections now open) 2015-06-13T03:38:02.685+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34455 #760 (6 connections now open) 2015-06-13T03:38:15.028+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:38:14.886+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:38:15.521+0000 I NETWORK [conn759] end connection 10.3.1.100:59178 (5 connections now open) 2015-06-13T03:38:15.521+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59181 #761 (6 connections now open) 2015-06-13T03:38:32.697+0000 I NETWORK [conn760] end connection 10.3.1.102:34455 (5 connections now open) 2015-06-13T03:38:32.698+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34457 #762 (6 connections now open) 2015-06-13T03:38:45.171+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:38:45.029+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:38:45.530+0000 I NETWORK [conn761] end connection 10.3.1.100:59181 (5 connections now open) 2015-06-13T03:38:45.531+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59183 #763 (6 connections now open) 2015-06-13T03:39:02.707+0000 I NETWORK [conn762] end connection 10.3.1.102:34457 (5 connections now open) 2015-06-13T03:39:02.707+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34459 #764 (6 connections now open) 2015-06-13T03:39:15.319+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:39:15.172+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:39:15.544+0000 I NETWORK [conn763] end connection 10.3.1.100:59183 (5 connections now open) 2015-06-13T03:39:15.544+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59185 #765 (6 connections now open) 2015-06-13T03:39:32.716+0000 I NETWORK [conn764] end connection 10.3.1.102:34459 (5 connections now open) 2015-06-13T03:39:32.716+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34461 #766 (6 connections now open) 2015-06-13T03:39:45.462+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:39:45.319+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:39:45.554+0000 I NETWORK [conn765] end connection 10.3.1.100:59185 (5 connections now open) 2015-06-13T03:39:45.554+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59187 #767 (6 connections now open) 2015-06-13T03:40:02.729+0000 I NETWORK [conn766] end connection 10.3.1.102:34461 (5 connections now open) 2015-06-13T03:40:02.729+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34463 #768 (6 connections now open) 2015-06-13T03:40:15.563+0000 I NETWORK [conn767] end connection 10.3.1.100:59187 (5 connections now open) 2015-06-13T03:40:15.563+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59189 #769 (6 connections now open) 2015-06-13T03:40:15.606+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:40:15.462+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:40:32.738+0000 I NETWORK [conn768] end connection 10.3.1.102:34463 (5 connections now open) 2015-06-13T03:40:32.738+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34465 #770 (6 connections now open) 2015-06-13T03:40:45.570+0000 I NETWORK [conn769] end connection 10.3.1.100:59189 (5 connections now open) 2015-06-13T03:40:45.570+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59191 #771 (6 connections now open) 2015-06-13T03:40:45.751+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:40:45.606+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:41:02.749+0000 I NETWORK [conn770] end connection 10.3.1.102:34465 (5 connections now open) 2015-06-13T03:41:02.749+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34467 #772 (6 connections now open) 2015-06-13T03:41:15.582+0000 I NETWORK [conn771] end connection 10.3.1.100:59191 (5 connections now open) 2015-06-13T03:41:15.582+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59193 #773 (6 connections now open) 2015-06-13T03:41:15.931+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:41:15.751+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:41:32.763+0000 I NETWORK [conn772] end connection 10.3.1.102:34467 (5 connections now open) 2015-06-13T03:41:32.763+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34469 #774 (6 connections now open) 2015-06-13T03:41:45.592+0000 I NETWORK [conn773] end connection 10.3.1.100:59193 (5 connections now open) 2015-06-13T03:41:45.592+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59195 #775 (6 connections now open) 2015-06-13T03:41:46.109+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:41:45.932+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:42:02.770+0000 I NETWORK [conn774] end connection 10.3.1.102:34469 (5 connections now open) 2015-06-13T03:42:02.771+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34471 #776 (6 connections now open) 2015-06-13T03:42:15.602+0000 I NETWORK [conn775] end connection 10.3.1.100:59195 (5 connections now open) 2015-06-13T03:42:15.603+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59197 #777 (6 connections now open) 2015-06-13T03:42:16.289+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:42:16.109+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:42:32.782+0000 I NETWORK [conn776] end connection 10.3.1.102:34471 (5 connections now open) 2015-06-13T03:42:32.782+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34473 #778 (6 connections now open) 2015-06-13T03:42:45.613+0000 I NETWORK [conn777] end connection 10.3.1.100:59197 (5 connections now open) 2015-06-13T03:42:45.613+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59199 #779 (6 connections now open) 2015-06-13T03:42:46.537+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:42:46.289+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:43:02.789+0000 I NETWORK [conn778] end connection 10.3.1.102:34473 (5 connections now open) 2015-06-13T03:43:02.789+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34475 #780 (6 connections now open) 2015-06-13T03:43:15.619+0000 I NETWORK [conn779] end connection 10.3.1.100:59199 (5 connections now open) 2015-06-13T03:43:15.620+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59201 #781 (6 connections now open) 2015-06-13T03:43:16.817+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:43:16.538+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:43:32.801+0000 I NETWORK [conn780] end connection 10.3.1.102:34475 (5 connections now open) 2015-06-13T03:43:32.801+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34477 #782 (6 connections now open) 2015-06-13T03:43:45.628+0000 I NETWORK [conn781] end connection 10.3.1.100:59201 (5 connections now open) 2015-06-13T03:43:45.629+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59203 #783 (6 connections now open) 2015-06-13T03:43:47.064+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:43:46.818+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:44:02.812+0000 I NETWORK [conn782] end connection 10.3.1.102:34477 (5 connections now open) 2015-06-13T03:44:02.813+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34479 #784 (6 connections now open) 2015-06-13T03:44:15.637+0000 I NETWORK [conn783] end connection 10.3.1.100:59203 (5 connections now open) 2015-06-13T03:44:15.637+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59205 #785 (6 connections now open) 2015-06-13T03:44:17.350+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:44:17.065+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:44:32.822+0000 I NETWORK [conn784] end connection 10.3.1.102:34479 (5 connections now open) 2015-06-13T03:44:32.823+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34481 #786 (6 connections now open) 2015-06-13T03:44:45.646+0000 I NETWORK [conn785] end connection 10.3.1.100:59205 (5 connections now open) 2015-06-13T03:44:45.647+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59207 #787 (6 connections now open) 2015-06-13T03:44:47.630+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:44:47.350+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:45:02.833+0000 I NETWORK [conn786] end connection 10.3.1.102:34481 (5 connections now open) 2015-06-13T03:45:02.833+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34483 #788 (6 connections now open) 2015-06-13T03:45:15.660+0000 I NETWORK [conn787] end connection 10.3.1.100:59207 (5 connections now open) 2015-06-13T03:45:15.660+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59209 #789 (6 connections now open) 2015-06-13T03:45:17.911+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:45:17.631+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:45:32.842+0000 I NETWORK [conn788] end connection 10.3.1.102:34483 (5 connections now open) 2015-06-13T03:45:32.842+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34485 #790 (6 connections now open) 2015-06-13T03:45:45.672+0000 I NETWORK [conn789] end connection 10.3.1.100:59209 (5 connections now open) 2015-06-13T03:45:45.672+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59211 #791 (6 connections now open) 2015-06-13T03:45:48.125+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:45:47.911+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:46:02.855+0000 I NETWORK [conn790] end connection 10.3.1.102:34485 (5 connections now open) 2015-06-13T03:46:02.855+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34487 #792 (6 connections now open) 2015-06-13T03:46:15.680+0000 I NETWORK [conn791] end connection 10.3.1.100:59211 (5 connections now open) 2015-06-13T03:46:15.680+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59213 #793 (6 connections now open) 2015-06-13T03:46:18.370+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:46:18.125+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:46:32.864+0000 I NETWORK [conn792] end connection 10.3.1.102:34487 (5 connections now open) 2015-06-13T03:46:32.864+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34489 #794 (6 connections now open) 2015-06-13T03:46:45.689+0000 I NETWORK [conn793] end connection 10.3.1.100:59213 (5 connections now open) 2015-06-13T03:46:45.689+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59215 #795 (6 connections now open) 2015-06-13T03:46:48.616+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:46:48.371+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:47:02.877+0000 I NETWORK [conn794] end connection 10.3.1.102:34489 (5 connections now open) 2015-06-13T03:47:02.877+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34491 #796 (6 connections now open) 2015-06-13T03:47:15.699+0000 I NETWORK [conn795] end connection 10.3.1.100:59215 (5 connections now open) 2015-06-13T03:47:15.699+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59217 #797 (6 connections now open) 2015-06-13T03:47:18.874+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:47:18.617+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:47:32.883+0000 I NETWORK [conn796] end connection 10.3.1.102:34491 (5 connections now open) 2015-06-13T03:47:32.883+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34493 #798 (6 connections now open) 2015-06-13T03:47:45.707+0000 I NETWORK [conn797] end connection 10.3.1.100:59217 (5 connections now open) 2015-06-13T03:47:45.707+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59219 #799 (6 connections now open) 2015-06-13T03:47:49.158+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:47:48.874+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:48:02.895+0000 I NETWORK [conn798] end connection 10.3.1.102:34493 (5 connections now open) 2015-06-13T03:48:02.896+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34495 #800 (6 connections now open) 2015-06-13T03:48:15.719+0000 I NETWORK [conn799] end connection 10.3.1.100:59219 (5 connections now open) 2015-06-13T03:48:15.719+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59221 #801 (6 connections now open) 2015-06-13T03:48:19.449+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:48:19.158+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:48:32.905+0000 I NETWORK [conn800] end connection 10.3.1.102:34495 (5 connections now open) 2015-06-13T03:48:32.905+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34497 #802 (6 connections now open) 2015-06-13T03:48:45.728+0000 I NETWORK [conn801] end connection 10.3.1.100:59221 (5 connections now open) 2015-06-13T03:48:45.728+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59223 #803 (6 connections now open) 2015-06-13T03:48:49.705+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:48:49.449+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:49:02.919+0000 I NETWORK [conn802] end connection 10.3.1.102:34497 (5 connections now open) 2015-06-13T03:49:02.919+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34499 #804 (6 connections now open) 2015-06-13T03:49:15.734+0000 I NETWORK [conn803] end connection 10.3.1.100:59223 (5 connections now open) 2015-06-13T03:49:15.735+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59225 #805 (6 connections now open) 2015-06-13T03:49:19.957+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:49:19.706+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:49:32.925+0000 I NETWORK [conn804] end connection 10.3.1.102:34499 (5 connections now open) 2015-06-13T03:49:32.926+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34501 #806 (6 connections now open) 2015-06-13T03:49:45.742+0000 I NETWORK [conn805] end connection 10.3.1.100:59225 (5 connections now open) 2015-06-13T03:49:45.742+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59227 #807 (6 connections now open) 2015-06-13T03:49:50.239+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:49:49.957+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:50:02.938+0000 I NETWORK [conn806] end connection 10.3.1.102:34501 (5 connections now open) 2015-06-13T03:50:02.938+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34503 #808 (6 connections now open) 2015-06-13T03:50:15.752+0000 I NETWORK [conn807] end connection 10.3.1.100:59227 (5 connections now open) 2015-06-13T03:50:15.752+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59229 #809 (6 connections now open) 2015-06-13T03:50:20.418+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:50:20.240+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:50:32.952+0000 I NETWORK [conn808] end connection 10.3.1.102:34503 (5 connections now open) 2015-06-13T03:50:32.952+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34505 #810 (6 connections now open) 2015-06-13T03:50:45.758+0000 I NETWORK [conn809] end connection 10.3.1.100:59229 (5 connections now open) 2015-06-13T03:50:45.758+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59231 #811 (6 connections now open) 2015-06-13T03:50:50.563+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:50:50.418+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:51:02.964+0000 I NETWORK [conn810] end connection 10.3.1.102:34505 (5 connections now open) 2015-06-13T03:51:02.964+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34507 #812 (6 connections now open) 2015-06-13T03:51:15.770+0000 I NETWORK [conn811] end connection 10.3.1.100:59231 (5 connections now open) 2015-06-13T03:51:15.770+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59233 #813 (6 connections now open) 2015-06-13T03:51:20.741+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:51:20.563+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:51:32.978+0000 I NETWORK [conn812] end connection 10.3.1.102:34507 (5 connections now open) 2015-06-13T03:51:32.978+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34509 #814 (6 connections now open) 2015-06-13T03:51:45.781+0000 I NETWORK [conn813] end connection 10.3.1.100:59233 (5 connections now open) 2015-06-13T03:51:45.781+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59235 #815 (6 connections now open) 2015-06-13T03:51:50.953+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:51:50.741+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:52:02.990+0000 I NETWORK [conn814] end connection 10.3.1.102:34509 (5 connections now open) 2015-06-13T03:52:02.990+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34511 #816 (6 connections now open) 2015-06-13T03:52:15.790+0000 I NETWORK [conn815] end connection 10.3.1.100:59235 (5 connections now open) 2015-06-13T03:52:15.790+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59237 #817 (6 connections now open) 2015-06-13T03:52:21.097+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:52:20.953+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:52:32.998+0000 I NETWORK [conn816] end connection 10.3.1.102:34511 (5 connections now open) 2015-06-13T03:52:32.999+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34513 #818 (6 connections now open) 2015-06-13T03:52:45.800+0000 I NETWORK [conn817] end connection 10.3.1.100:59237 (5 connections now open) 2015-06-13T03:52:45.801+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59239 #819 (6 connections now open) 2015-06-13T03:52:51.276+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:52:51.097+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:53:03.009+0000 I NETWORK [conn818] end connection 10.3.1.102:34513 (5 connections now open) 2015-06-13T03:53:03.009+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34515 #820 (6 connections now open) 2015-06-13T03:53:15.809+0000 I NETWORK [conn819] end connection 10.3.1.100:59239 (5 connections now open) 2015-06-13T03:53:15.809+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59241 #821 (6 connections now open) 2015-06-13T03:53:21.557+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:53:21.276+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:53:33.022+0000 I NETWORK [conn820] end connection 10.3.1.102:34515 (5 connections now open) 2015-06-13T03:53:33.022+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34517 #822 (6 connections now open) 2015-06-13T03:53:45.818+0000 I NETWORK [conn821] end connection 10.3.1.100:59241 (5 connections now open) 2015-06-13T03:53:45.818+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59243 #823 (6 connections now open) 2015-06-13T03:53:51.803+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:53:51.557+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:54:03.030+0000 I NETWORK [conn822] end connection 10.3.1.102:34517 (5 connections now open) 2015-06-13T03:54:03.031+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34519 #824 (6 connections now open) 2015-06-13T03:54:15.825+0000 I NETWORK [conn823] end connection 10.3.1.100:59243 (5 connections now open) 2015-06-13T03:54:15.825+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59245 #825 (6 connections now open) 2015-06-13T03:54:22.086+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:54:21.804+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:54:33.044+0000 I NETWORK [conn824] end connection 10.3.1.102:34519 (5 connections now open) 2015-06-13T03:54:33.044+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34521 #826 (6 connections now open) 2015-06-13T03:54:45.833+0000 I NETWORK [conn825] end connection 10.3.1.100:59245 (5 connections now open) 2015-06-13T03:54:45.833+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59247 #827 (6 connections now open) 2015-06-13T03:54:52.364+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:54:52.086+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:55:03.052+0000 I NETWORK [conn826] end connection 10.3.1.102:34521 (5 connections now open) 2015-06-13T03:55:03.053+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34523 #828 (6 connections now open) 2015-06-13T03:55:15.842+0000 I NETWORK [conn827] end connection 10.3.1.100:59247 (5 connections now open) 2015-06-13T03:55:15.842+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59249 #829 (6 connections now open) 2015-06-13T03:55:22.647+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:55:22.364+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:55:33.062+0000 I NETWORK [conn828] end connection 10.3.1.102:34523 (5 connections now open) 2015-06-13T03:55:33.063+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34525 #830 (6 connections now open) 2015-06-13T03:55:45.851+0000 I NETWORK [conn829] end connection 10.3.1.100:59249 (5 connections now open) 2015-06-13T03:55:45.851+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59251 #831 (6 connections now open) 2015-06-13T03:55:52.929+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:55:52.647+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:56:03.075+0000 I NETWORK [conn830] end connection 10.3.1.102:34525 (5 connections now open) 2015-06-13T03:56:03.075+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34527 #832 (6 connections now open) 2015-06-13T03:56:15.859+0000 I NETWORK [conn831] end connection 10.3.1.100:59251 (5 connections now open) 2015-06-13T03:56:15.859+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59253 #833 (6 connections now open) 2015-06-13T03:56:23.209+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:56:22.929+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:56:33.086+0000 I NETWORK [conn832] end connection 10.3.1.102:34527 (5 connections now open) 2015-06-13T03:56:33.086+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34529 #834 (6 connections now open) 2015-06-13T03:56:45.868+0000 I NETWORK [conn833] end connection 10.3.1.100:59253 (5 connections now open) 2015-06-13T03:56:45.868+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59255 #835 (6 connections now open) 2015-06-13T03:56:53.490+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:56:53.209+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:57:03.096+0000 I NETWORK [conn834] end connection 10.3.1.102:34529 (5 connections now open) 2015-06-13T03:57:03.097+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34531 #836 (6 connections now open) 2015-06-13T03:57:15.875+0000 I NETWORK [conn835] end connection 10.3.1.100:59255 (5 connections now open) 2015-06-13T03:57:15.875+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59257 #837 (6 connections now open) 2015-06-13T03:57:23.772+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:57:23.490+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:57:33.106+0000 I NETWORK [conn836] end connection 10.3.1.102:34531 (5 connections now open) 2015-06-13T03:57:33.106+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34533 #838 (6 connections now open) 2015-06-13T03:57:45.883+0000 I NETWORK [conn837] end connection 10.3.1.100:59257 (5 connections now open) 2015-06-13T03:57:45.883+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59259 #839 (6 connections now open) 2015-06-13T03:57:54.053+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:57:53.772+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:58:03.115+0000 I NETWORK [conn838] end connection 10.3.1.102:34533 (5 connections now open) 2015-06-13T03:58:03.116+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34535 #840 (6 connections now open) 2015-06-13T03:58:15.889+0000 I NETWORK [conn839] end connection 10.3.1.100:59259 (5 connections now open) 2015-06-13T03:58:15.889+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59261 #841 (6 connections now open) 2015-06-13T03:58:24.334+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:58:24.054+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:58:33.123+0000 I NETWORK [conn840] end connection 10.3.1.102:34535 (5 connections now open) 2015-06-13T03:58:33.124+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34537 #842 (6 connections now open) 2015-06-13T03:58:45.897+0000 I NETWORK [conn841] end connection 10.3.1.100:59261 (5 connections now open) 2015-06-13T03:58:45.897+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59263 #843 (6 connections now open) 2015-06-13T03:58:54.613+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:58:54.334+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:59:03.138+0000 I NETWORK [conn842] end connection 10.3.1.102:34537 (5 connections now open) 2015-06-13T03:59:03.138+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34539 #844 (6 connections now open) 2015-06-13T03:59:15.905+0000 I NETWORK [conn843] end connection 10.3.1.100:59263 (5 connections now open) 2015-06-13T03:59:15.905+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59265 #845 (6 connections now open) 2015-06-13T03:59:24.896+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:59:24.613+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T03:59:33.151+0000 I NETWORK [conn844] end connection 10.3.1.102:34539 (5 connections now open) 2015-06-13T03:59:33.151+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34542 #846 (6 connections now open) 2015-06-13T03:59:45.914+0000 I NETWORK [conn845] end connection 10.3.1.100:59265 (5 connections now open) 2015-06-13T03:59:45.914+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59267 #847 (6 connections now open) 2015-06-13T03:59:55.175+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T03:59:54.896+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:00:03.162+0000 I NETWORK [conn846] end connection 10.3.1.102:34542 (5 connections now open) 2015-06-13T04:00:03.162+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34544 #848 (6 connections now open) 2015-06-13T04:00:15.923+0000 I NETWORK [conn847] end connection 10.3.1.100:59267 (5 connections now open) 2015-06-13T04:00:15.923+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59269 #849 (6 connections now open) 2015-06-13T04:00:25.457+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:00:25.175+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:00:33.170+0000 I NETWORK [conn848] end connection 10.3.1.102:34544 (5 connections now open) 2015-06-13T04:00:33.171+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34546 #850 (6 connections now open) 2015-06-13T04:00:45.932+0000 I NETWORK [conn849] end connection 10.3.1.100:59269 (5 connections now open) 2015-06-13T04:00:45.933+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59271 #851 (6 connections now open) 2015-06-13T04:00:55.737+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:00:55.457+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:01:03.180+0000 I NETWORK [conn850] end connection 10.3.1.102:34546 (5 connections now open) 2015-06-13T04:01:03.181+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34548 #852 (6 connections now open) 2015-06-13T04:01:15.941+0000 I NETWORK [conn851] end connection 10.3.1.100:59271 (5 connections now open) 2015-06-13T04:01:15.942+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59273 #853 (6 connections now open) 2015-06-13T04:01:25.984+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:01:25.737+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:01:33.189+0000 I NETWORK [conn852] end connection 10.3.1.102:34548 (5 connections now open) 2015-06-13T04:01:33.189+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34550 #854 (6 connections now open) 2015-06-13T04:01:45.950+0000 I NETWORK [conn853] end connection 10.3.1.100:59273 (5 connections now open) 2015-06-13T04:01:45.951+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59275 #855 (6 connections now open) 2015-06-13T04:01:56.263+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:01:55.984+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:02:03.196+0000 I NETWORK [conn854] end connection 10.3.1.102:34550 (5 connections now open) 2015-06-13T04:02:03.197+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34552 #856 (6 connections now open) 2015-06-13T04:02:15.962+0000 I NETWORK [conn855] end connection 10.3.1.100:59275 (5 connections now open) 2015-06-13T04:02:15.963+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59277 #857 (6 connections now open) 2015-06-13T04:02:26.545+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:02:26.263+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:02:33.205+0000 I NETWORK [conn856] end connection 10.3.1.102:34552 (5 connections now open) 2015-06-13T04:02:33.206+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34554 #858 (6 connections now open) 2015-06-13T04:02:45.970+0000 I NETWORK [conn857] end connection 10.3.1.100:59277 (5 connections now open) 2015-06-13T04:02:45.971+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59279 #859 (6 connections now open) 2015-06-13T04:02:56.721+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:02:56.545+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:03:03.212+0000 I NETWORK [conn858] end connection 10.3.1.102:34554 (5 connections now open) 2015-06-13T04:03:03.213+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34556 #860 (6 connections now open) 2015-06-13T04:03:15.977+0000 I NETWORK [conn859] end connection 10.3.1.100:59279 (5 connections now open) 2015-06-13T04:03:15.977+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59281 #861 (6 connections now open) 2015-06-13T04:03:26.868+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:03:26.721+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:03:33.223+0000 I NETWORK [conn860] end connection 10.3.1.102:34556 (5 connections now open) 2015-06-13T04:03:33.223+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34558 #862 (6 connections now open) 2015-06-13T04:03:45.986+0000 I NETWORK [conn861] end connection 10.3.1.100:59281 (5 connections now open) 2015-06-13T04:03:45.987+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59283 #863 (6 connections now open) 2015-06-13T04:03:57.013+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:03:56.868+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:04:03.232+0000 I NETWORK [conn862] end connection 10.3.1.102:34558 (5 connections now open) 2015-06-13T04:04:03.232+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34560 #864 (6 connections now open) 2015-06-13T04:04:15.995+0000 I NETWORK [conn863] end connection 10.3.1.100:59283 (5 connections now open) 2015-06-13T04:04:15.995+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59285 #865 (6 connections now open) 2015-06-13T04:04:27.157+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:04:27.013+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:04:33.244+0000 I NETWORK [conn864] end connection 10.3.1.102:34560 (5 connections now open) 2015-06-13T04:04:33.244+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34562 #866 (6 connections now open) 2015-06-13T04:04:46.003+0000 I NETWORK [conn865] end connection 10.3.1.100:59285 (5 connections now open) 2015-06-13T04:04:46.003+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59287 #867 (6 connections now open) 2015-06-13T04:04:57.302+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:04:57.157+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:05:03.254+0000 I NETWORK [conn866] end connection 10.3.1.102:34562 (5 connections now open) 2015-06-13T04:05:03.254+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34564 #868 (6 connections now open) 2015-06-13T04:05:16.009+0000 I NETWORK [conn867] end connection 10.3.1.100:59287 (5 connections now open) 2015-06-13T04:05:16.010+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59289 #869 (6 connections now open) 2015-06-13T04:05:27.446+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:05:27.302+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:05:33.263+0000 I NETWORK [conn868] end connection 10.3.1.102:34564 (5 connections now open) 2015-06-13T04:05:33.264+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34566 #870 (6 connections now open) 2015-06-13T04:05:46.016+0000 I NETWORK [conn869] end connection 10.3.1.100:59289 (5 connections now open) 2015-06-13T04:05:46.017+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59291 #871 (6 connections now open) 2015-06-13T04:05:57.695+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:05:57.446+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:06:03.274+0000 I NETWORK [conn870] end connection 10.3.1.102:34566 (5 connections now open) 2015-06-13T04:06:03.274+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34568 #872 (6 connections now open) 2015-06-13T04:06:16.026+0000 I NETWORK [conn871] end connection 10.3.1.100:59291 (5 connections now open) 2015-06-13T04:06:16.026+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59294 #873 (6 connections now open) 2015-06-13T04:06:27.942+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:06:27.695+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:06:33.283+0000 I NETWORK [conn872] end connection 10.3.1.102:34568 (5 connections now open) 2015-06-13T04:06:33.283+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34570 #874 (6 connections now open) 2015-06-13T04:06:46.035+0000 I NETWORK [conn873] end connection 10.3.1.100:59294 (5 connections now open) 2015-06-13T04:06:46.035+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59296 #875 (6 connections now open) 2015-06-13T04:06:58.191+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:06:57.943+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:07:03.292+0000 I NETWORK [conn874] end connection 10.3.1.102:34570 (5 connections now open) 2015-06-13T04:07:03.292+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34572 #876 (6 connections now open) 2015-06-13T04:07:16.045+0000 I NETWORK [conn875] end connection 10.3.1.100:59296 (5 connections now open) 2015-06-13T04:07:16.045+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59298 #877 (6 connections now open) 2015-06-13T04:07:28.366+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:07:28.191+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:07:33.297+0000 I NETWORK [conn876] end connection 10.3.1.102:34572 (5 connections now open) 2015-06-13T04:07:33.297+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34574 #878 (6 connections now open) 2015-06-13T04:07:46.053+0000 I NETWORK [conn877] end connection 10.3.1.100:59298 (5 connections now open) 2015-06-13T04:07:46.053+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59300 #879 (6 connections now open) 2015-06-13T04:07:58.614+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:07:58.366+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:08:03.305+0000 I NETWORK [conn878] end connection 10.3.1.102:34574 (5 connections now open) 2015-06-13T04:08:03.305+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34576 #880 (6 connections now open) 2015-06-13T04:08:16.061+0000 I NETWORK [conn879] end connection 10.3.1.100:59300 (5 connections now open) 2015-06-13T04:08:16.061+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59302 #881 (6 connections now open) 2015-06-13T04:08:28.895+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:08:28.614+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:08:33.314+0000 I NETWORK [conn880] end connection 10.3.1.102:34576 (5 connections now open) 2015-06-13T04:08:33.314+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34578 #882 (6 connections now open) 2015-06-13T04:08:46.068+0000 I NETWORK [conn881] end connection 10.3.1.100:59302 (5 connections now open) 2015-06-13T04:08:46.068+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59304 #883 (6 connections now open) 2015-06-13T04:08:59.141+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:08:58.895+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:09:03.325+0000 I NETWORK [conn882] end connection 10.3.1.102:34578 (5 connections now open) 2015-06-13T04:09:03.325+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34580 #884 (6 connections now open) 2015-06-13T04:09:16.079+0000 I NETWORK [conn883] end connection 10.3.1.100:59304 (5 connections now open) 2015-06-13T04:09:16.079+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59306 #885 (6 connections now open) 2015-06-13T04:09:29.386+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:09:29.141+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:09:33.333+0000 I NETWORK [conn884] end connection 10.3.1.102:34580 (5 connections now open) 2015-06-13T04:09:33.333+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34582 #886 (6 connections now open) 2015-06-13T04:09:46.085+0000 I NETWORK [conn885] end connection 10.3.1.100:59306 (5 connections now open) 2015-06-13T04:09:46.086+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59308 #887 (6 connections now open) 2015-06-13T04:09:59.634+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:09:59.386+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:10:03.343+0000 I NETWORK [conn886] end connection 10.3.1.102:34582 (5 connections now open) 2015-06-13T04:10:03.344+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34584 #888 (6 connections now open) 2015-06-13T04:10:16.099+0000 I NETWORK [conn887] end connection 10.3.1.100:59308 (5 connections now open) 2015-06-13T04:10:16.099+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59310 #889 (6 connections now open) 2015-06-13T04:10:29.881+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:10:29.634+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:10:33.351+0000 I NETWORK [conn888] end connection 10.3.1.102:34584 (5 connections now open) 2015-06-13T04:10:33.351+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34586 #890 (6 connections now open) 2015-06-13T04:10:46.105+0000 I NETWORK [conn889] end connection 10.3.1.100:59310 (5 connections now open) 2015-06-13T04:10:46.106+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59312 #891 (6 connections now open) 2015-06-13T04:11:00.163+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:10:59.881+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:11:03.358+0000 I NETWORK [conn890] end connection 10.3.1.102:34586 (5 connections now open) 2015-06-13T04:11:03.358+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34588 #892 (6 connections now open) 2015-06-13T04:11:16.115+0000 I NETWORK [conn891] end connection 10.3.1.100:59312 (5 connections now open) 2015-06-13T04:11:16.116+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59314 #893 (6 connections now open) 2015-06-13T04:11:30.450+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:11:30.164+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:11:33.368+0000 I NETWORK [conn892] end connection 10.3.1.102:34588 (5 connections now open) 2015-06-13T04:11:33.369+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34590 #894 (6 connections now open) 2015-06-13T04:11:46.124+0000 I NETWORK [conn893] end connection 10.3.1.100:59314 (5 connections now open) 2015-06-13T04:11:46.124+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59316 #895 (6 connections now open) 2015-06-13T04:12:00.733+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:12:00.450+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:12:03.378+0000 I NETWORK [conn894] end connection 10.3.1.102:34590 (5 connections now open) 2015-06-13T04:12:03.378+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34592 #896 (6 connections now open) 2015-06-13T04:12:16.135+0000 I NETWORK [conn895] end connection 10.3.1.100:59316 (5 connections now open) 2015-06-13T04:12:16.135+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59318 #897 (6 connections now open) 2015-06-13T04:12:31.015+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:12:30.733+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:12:33.389+0000 I NETWORK [conn896] end connection 10.3.1.102:34592 (5 connections now open) 2015-06-13T04:12:33.389+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34594 #898 (6 connections now open) 2015-06-13T04:12:46.142+0000 I NETWORK [conn897] end connection 10.3.1.100:59318 (5 connections now open) 2015-06-13T04:12:46.142+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59320 #899 (6 connections now open) 2015-06-13T04:13:01.297+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:13:01.015+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:13:03.399+0000 I NETWORK [conn898] end connection 10.3.1.102:34594 (5 connections now open) 2015-06-13T04:13:03.399+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34596 #900 (6 connections now open) 2015-06-13T04:13:16.150+0000 I NETWORK [conn899] end connection 10.3.1.100:59320 (5 connections now open) 2015-06-13T04:13:16.151+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59322 #901 (6 connections now open) 2015-06-13T04:13:31.579+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:13:31.297+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:13:33.408+0000 I NETWORK [conn900] end connection 10.3.1.102:34596 (5 connections now open) 2015-06-13T04:13:33.408+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34598 #902 (6 connections now open) 2015-06-13T04:13:46.159+0000 I NETWORK [conn901] end connection 10.3.1.100:59322 (5 connections now open) 2015-06-13T04:13:46.159+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59324 #903 (6 connections now open) 2015-06-13T04:14:01.860+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:14:01.579+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:14:03.418+0000 I NETWORK [conn902] end connection 10.3.1.102:34598 (5 connections now open) 2015-06-13T04:14:03.418+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34600 #904 (6 connections now open) 2015-06-13T04:14:16.167+0000 I NETWORK [conn903] end connection 10.3.1.100:59324 (5 connections now open) 2015-06-13T04:14:16.167+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59326 #905 (6 connections now open) 2015-06-13T04:14:32.140+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:14:31.860+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:14:33.426+0000 I NETWORK [conn904] end connection 10.3.1.102:34600 (5 connections now open) 2015-06-13T04:14:33.426+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34602 #906 (6 connections now open) 2015-06-13T04:14:46.174+0000 I NETWORK [conn905] end connection 10.3.1.100:59326 (5 connections now open) 2015-06-13T04:14:46.175+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59328 #907 (6 connections now open) 2015-06-13T04:15:02.420+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:15:02.140+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:15:03.432+0000 I NETWORK [conn906] end connection 10.3.1.102:34602 (5 connections now open) 2015-06-13T04:15:03.432+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34604 #908 (6 connections now open) 2015-06-13T04:15:16.185+0000 I NETWORK [conn907] end connection 10.3.1.100:59328 (5 connections now open) 2015-06-13T04:15:16.185+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59330 #909 (6 connections now open) 2015-06-13T04:15:32.704+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:15:32.420+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:15:33.441+0000 I NETWORK [conn908] end connection 10.3.1.102:34604 (5 connections now open) 2015-06-13T04:15:33.441+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34606 #910 (6 connections now open) 2015-06-13T04:15:46.193+0000 I NETWORK [conn909] end connection 10.3.1.100:59330 (5 connections now open) 2015-06-13T04:15:46.193+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59332 #911 (6 connections now open) 2015-06-13T04:16:02.984+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:16:02.704+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:16:03.454+0000 I NETWORK [conn910] end connection 10.3.1.102:34606 (5 connections now open) 2015-06-13T04:16:03.454+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34608 #912 (6 connections now open) 2015-06-13T04:16:16.201+0000 I NETWORK [conn911] end connection 10.3.1.100:59332 (5 connections now open) 2015-06-13T04:16:16.202+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59334 #913 (6 connections now open) 2015-06-13T04:16:33.134+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:16:32.984+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:16:33.468+0000 I NETWORK [conn912] end connection 10.3.1.102:34608 (5 connections now open) 2015-06-13T04:16:33.469+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34610 #914 (6 connections now open) 2015-06-13T04:16:46.213+0000 I NETWORK [conn913] end connection 10.3.1.100:59334 (5 connections now open) 2015-06-13T04:16:46.213+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59336 #915 (6 connections now open) 2015-06-13T04:17:03.395+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:17:03.134+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:17:03.479+0000 I NETWORK [conn914] end connection 10.3.1.102:34610 (5 connections now open) 2015-06-13T04:17:03.479+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34612 #916 (6 connections now open) 2015-06-13T04:17:16.220+0000 I NETWORK [conn915] end connection 10.3.1.100:59336 (5 connections now open) 2015-06-13T04:17:16.221+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59338 #917 (6 connections now open) 2015-06-13T04:17:33.489+0000 I NETWORK [conn916] end connection 10.3.1.102:34612 (5 connections now open) 2015-06-13T04:17:33.489+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34614 #918 (6 connections now open) 2015-06-13T04:17:33.644+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:17:33.395+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:17:46.230+0000 I NETWORK [conn917] end connection 10.3.1.100:59338 (5 connections now open) 2015-06-13T04:17:46.230+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59340 #919 (6 connections now open) 2015-06-13T04:18:03.499+0000 I NETWORK [conn918] end connection 10.3.1.102:34614 (5 connections now open) 2015-06-13T04:18:03.499+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34616 #920 (6 connections now open) 2015-06-13T04:18:03.804+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:18:03.644+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:18:16.240+0000 I NETWORK [conn919] end connection 10.3.1.100:59340 (5 connections now open) 2015-06-13T04:18:16.240+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59342 #921 (6 connections now open) 2015-06-13T04:18:33.509+0000 I NETWORK [conn920] end connection 10.3.1.102:34616 (5 connections now open) 2015-06-13T04:18:33.510+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34618 #922 (6 connections now open) 2015-06-13T04:18:33.947+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:18:33.805+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:18:46.248+0000 I NETWORK [conn921] end connection 10.3.1.100:59342 (5 connections now open) 2015-06-13T04:18:46.249+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59344 #923 (6 connections now open) 2015-06-13T04:19:03.521+0000 I NETWORK [conn922] end connection 10.3.1.102:34618 (5 connections now open) 2015-06-13T04:19:03.521+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34620 #924 (6 connections now open) 2015-06-13T04:19:04.092+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:19:03.947+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:19:16.257+0000 I NETWORK [conn923] end connection 10.3.1.100:59344 (5 connections now open) 2015-06-13T04:19:16.258+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59346 #925 (6 connections now open) 2015-06-13T04:19:33.531+0000 I NETWORK [conn924] end connection 10.3.1.102:34620 (5 connections now open) 2015-06-13T04:19:33.531+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34622 #926 (6 connections now open) 2015-06-13T04:19:34.237+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:19:34.093+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:19:46.268+0000 I NETWORK [conn925] end connection 10.3.1.100:59346 (5 connections now open) 2015-06-13T04:19:46.268+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59348 #927 (6 connections now open) 2015-06-13T04:20:03.541+0000 I NETWORK [conn926] end connection 10.3.1.102:34622 (5 connections now open) 2015-06-13T04:20:03.541+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34624 #928 (6 connections now open) 2015-06-13T04:20:04.416+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:20:04.238+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:20:16.274+0000 I NETWORK [conn927] end connection 10.3.1.100:59348 (5 connections now open) 2015-06-13T04:20:16.275+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59350 #929 (6 connections now open) 2015-06-13T04:20:33.551+0000 I NETWORK [conn928] end connection 10.3.1.102:34624 (5 connections now open) 2015-06-13T04:20:33.551+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34626 #930 (6 connections now open) 2015-06-13T04:20:34.596+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:20:34.416+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:20:46.282+0000 I NETWORK [conn929] end connection 10.3.1.100:59350 (5 connections now open) 2015-06-13T04:20:46.282+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59352 #931 (6 connections now open) 2015-06-13T04:21:03.561+0000 I NETWORK [conn930] end connection 10.3.1.102:34626 (5 connections now open) 2015-06-13T04:21:03.561+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34628 #932 (6 connections now open) 2015-06-13T04:21:04.738+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:21:04.596+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:21:16.291+0000 I NETWORK [conn931] end connection 10.3.1.100:59352 (5 connections now open) 2015-06-13T04:21:16.291+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59354 #933 (6 connections now open) 2015-06-13T04:21:33.572+0000 I NETWORK [conn932] end connection 10.3.1.102:34628 (5 connections now open) 2015-06-13T04:21:33.572+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34630 #934 (6 connections now open) 2015-06-13T04:21:34.881+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:21:34.738+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:21:46.300+0000 I NETWORK [conn933] end connection 10.3.1.100:59354 (5 connections now open) 2015-06-13T04:21:46.300+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59356 #935 (6 connections now open) 2015-06-13T04:22:03.581+0000 I NETWORK [conn934] end connection 10.3.1.102:34630 (5 connections now open) 2015-06-13T04:22:03.581+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34632 #936 (6 connections now open) 2015-06-13T04:22:05.026+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:22:04.881+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:22:16.310+0000 I NETWORK [conn935] end connection 10.3.1.100:59356 (5 connections now open) 2015-06-13T04:22:16.310+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59358 #937 (6 connections now open) 2015-06-13T04:22:33.588+0000 I NETWORK [conn936] end connection 10.3.1.102:34632 (5 connections now open) 2015-06-13T04:22:33.589+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34634 #938 (6 connections now open) 2015-06-13T04:22:35.207+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:22:35.026+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:22:46.319+0000 I NETWORK [conn937] end connection 10.3.1.100:59358 (5 connections now open) 2015-06-13T04:22:46.319+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59360 #939 (6 connections now open) 2015-06-13T04:23:03.599+0000 I NETWORK [conn938] end connection 10.3.1.102:34634 (5 connections now open) 2015-06-13T04:23:03.600+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34636 #940 (6 connections now open) 2015-06-13T04:23:05.348+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:23:05.207+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:23:16.326+0000 I NETWORK [conn939] end connection 10.3.1.100:59360 (5 connections now open) 2015-06-13T04:23:16.327+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59362 #941 (6 connections now open) 2015-06-13T04:23:33.609+0000 I NETWORK [conn940] end connection 10.3.1.102:34636 (5 connections now open) 2015-06-13T04:23:33.609+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34638 #942 (6 connections now open) 2015-06-13T04:23:35.489+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:23:35.348+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:23:46.337+0000 I NETWORK [conn941] end connection 10.3.1.100:59362 (5 connections now open) 2015-06-13T04:23:46.337+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59364 #943 (6 connections now open) 2015-06-13T04:24:03.620+0000 I NETWORK [conn942] end connection 10.3.1.102:34638 (5 connections now open) 2015-06-13T04:24:03.620+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34640 #944 (6 connections now open) 2015-06-13T04:24:05.633+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:24:05.489+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:24:16.346+0000 I NETWORK [conn943] end connection 10.3.1.100:59364 (5 connections now open) 2015-06-13T04:24:16.346+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59366 #945 (6 connections now open) 2015-06-13T04:24:33.628+0000 I NETWORK [conn944] end connection 10.3.1.102:34640 (5 connections now open) 2015-06-13T04:24:33.628+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34642 #946 (6 connections now open) 2015-06-13T04:24:35.776+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:24:35.633+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:24:46.355+0000 I NETWORK [conn945] end connection 10.3.1.100:59366 (5 connections now open) 2015-06-13T04:24:46.355+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59368 #947 (6 connections now open) 2015-06-13T04:25:03.639+0000 I NETWORK [conn946] end connection 10.3.1.102:34642 (5 connections now open) 2015-06-13T04:25:03.639+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34644 #948 (6 connections now open) 2015-06-13T04:25:05.918+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:25:05.776+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:25:16.364+0000 I NETWORK [conn947] end connection 10.3.1.100:59368 (5 connections now open) 2015-06-13T04:25:16.364+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59370 #949 (6 connections now open) 2015-06-13T04:25:33.648+0000 I NETWORK [conn948] end connection 10.3.1.102:34644 (5 connections now open) 2015-06-13T04:25:33.648+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34646 #950 (6 connections now open) 2015-06-13T04:25:36.061+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:25:35.918+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:25:46.372+0000 I NETWORK [conn949] end connection 10.3.1.100:59370 (5 connections now open) 2015-06-13T04:25:46.372+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59372 #951 (6 connections now open) 2015-06-13T04:26:03.658+0000 I NETWORK [conn950] end connection 10.3.1.102:34646 (5 connections now open) 2015-06-13T04:26:03.658+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34648 #952 (6 connections now open) 2015-06-13T04:26:06.239+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:26:06.061+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:26:16.380+0000 I NETWORK [conn951] end connection 10.3.1.100:59372 (5 connections now open) 2015-06-13T04:26:16.380+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59374 #953 (6 connections now open) 2015-06-13T04:26:33.667+0000 I NETWORK [conn952] end connection 10.3.1.102:34648 (5 connections now open) 2015-06-13T04:26:33.667+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34650 #954 (6 connections now open) 2015-06-13T04:26:36.381+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:26:36.239+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:26:46.389+0000 I NETWORK [conn953] end connection 10.3.1.100:59374 (5 connections now open) 2015-06-13T04:26:46.389+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59376 #955 (6 connections now open) 2015-06-13T04:27:03.679+0000 I NETWORK [conn954] end connection 10.3.1.102:34650 (5 connections now open) 2015-06-13T04:27:03.679+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34652 #956 (6 connections now open) 2015-06-13T04:27:06.526+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:27:06.382+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:27:16.395+0000 I NETWORK [conn955] end connection 10.3.1.100:59376 (5 connections now open) 2015-06-13T04:27:16.396+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59378 #957 (6 connections now open) 2015-06-13T04:27:33.691+0000 I NETWORK [conn956] end connection 10.3.1.102:34652 (5 connections now open) 2015-06-13T04:27:33.691+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34654 #958 (6 connections now open) 2015-06-13T04:27:36.743+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:27:36.526+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:27:46.403+0000 I NETWORK [conn957] end connection 10.3.1.100:59378 (5 connections now open) 2015-06-13T04:27:46.403+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59380 #959 (6 connections now open) 2015-06-13T04:28:03.703+0000 I NETWORK [conn958] end connection 10.3.1.102:34654 (5 connections now open) 2015-06-13T04:28:03.703+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34657 #960 (6 connections now open) 2015-06-13T04:28:06.919+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:28:06.743+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:28:16.412+0000 I NETWORK [conn959] end connection 10.3.1.100:59380 (5 connections now open) 2015-06-13T04:28:16.413+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59382 #961 (6 connections now open) 2015-06-13T04:28:33.713+0000 I NETWORK [conn960] end connection 10.3.1.102:34657 (5 connections now open) 2015-06-13T04:28:33.713+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34659 #962 (6 connections now open) 2015-06-13T04:28:37.096+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:28:36.920+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:28:46.421+0000 I NETWORK [conn961] end connection 10.3.1.100:59382 (5 connections now open) 2015-06-13T04:28:46.422+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59384 #963 (6 connections now open) 2015-06-13T04:29:03.723+0000 I NETWORK [conn962] end connection 10.3.1.102:34659 (5 connections now open) 2015-06-13T04:29:03.723+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34661 #964 (6 connections now open) 2015-06-13T04:29:07.341+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:29:07.096+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:29:16.431+0000 I NETWORK [conn963] end connection 10.3.1.100:59384 (5 connections now open) 2015-06-13T04:29:16.431+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59386 #965 (6 connections now open) 2015-06-13T04:29:33.736+0000 I NETWORK [conn964] end connection 10.3.1.102:34661 (5 connections now open) 2015-06-13T04:29:33.736+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34663 #966 (6 connections now open) 2015-06-13T04:29:37.587+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:29:37.341+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:29:46.439+0000 I NETWORK [conn965] end connection 10.3.1.100:59386 (5 connections now open) 2015-06-13T04:29:46.439+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59388 #967 (6 connections now open) 2015-06-13T04:30:03.746+0000 I NETWORK [conn966] end connection 10.3.1.102:34663 (5 connections now open) 2015-06-13T04:30:03.746+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34665 #968 (6 connections now open) 2015-06-13T04:30:07.832+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:30:07.588+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:30:16.450+0000 I NETWORK [conn967] end connection 10.3.1.100:59388 (5 connections now open) 2015-06-13T04:30:16.450+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59390 #969 (6 connections now open) 2015-06-13T04:30:33.757+0000 I NETWORK [conn968] end connection 10.3.1.102:34665 (5 connections now open) 2015-06-13T04:30:33.758+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34667 #970 (6 connections now open) 2015-06-13T04:30:38.077+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:30:37.832+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:30:46.460+0000 I NETWORK [conn969] end connection 10.3.1.100:59390 (5 connections now open) 2015-06-13T04:30:46.460+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59392 #971 (6 connections now open) 2015-06-13T04:31:03.765+0000 I NETWORK [conn970] end connection 10.3.1.102:34667 (5 connections now open) 2015-06-13T04:31:03.766+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34669 #972 (6 connections now open) 2015-06-13T04:31:08.326+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:31:08.077+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:31:16.469+0000 I NETWORK [conn971] end connection 10.3.1.100:59392 (5 connections now open) 2015-06-13T04:31:16.469+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59394 #973 (6 connections now open) 2015-06-13T04:31:33.777+0000 I NETWORK [conn972] end connection 10.3.1.102:34669 (5 connections now open) 2015-06-13T04:31:33.777+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34671 #974 (6 connections now open) 2015-06-13T04:31:38.573+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:31:38.326+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:31:46.477+0000 I NETWORK [conn973] end connection 10.3.1.100:59394 (5 connections now open) 2015-06-13T04:31:46.477+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59396 #975 (6 connections now open) 2015-06-13T04:32:03.788+0000 I NETWORK [conn974] end connection 10.3.1.102:34671 (5 connections now open) 2015-06-13T04:32:03.788+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34673 #976 (6 connections now open) 2015-06-13T04:32:08.819+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:32:08.573+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:32:16.487+0000 I NETWORK [conn975] end connection 10.3.1.100:59396 (5 connections now open) 2015-06-13T04:32:16.487+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59398 #977 (6 connections now open) 2015-06-13T04:32:33.798+0000 I NETWORK [conn976] end connection 10.3.1.102:34673 (5 connections now open) 2015-06-13T04:32:33.798+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34675 #978 (6 connections now open) 2015-06-13T04:32:39.001+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:32:38.819+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:32:46.495+0000 I NETWORK [conn977] end connection 10.3.1.100:59398 (5 connections now open) 2015-06-13T04:32:46.495+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59400 #979 (6 connections now open) 2015-06-13T04:33:03.808+0000 I NETWORK [conn978] end connection 10.3.1.102:34675 (5 connections now open) 2015-06-13T04:33:03.809+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34677 #980 (6 connections now open) 2015-06-13T04:33:09.144+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:33:09.001+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:33:16.502+0000 I NETWORK [conn979] end connection 10.3.1.100:59400 (5 connections now open) 2015-06-13T04:33:16.502+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59402 #981 (6 connections now open) 2015-06-13T04:33:33.819+0000 I NETWORK [conn980] end connection 10.3.1.102:34677 (5 connections now open) 2015-06-13T04:33:33.819+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34679 #982 (6 connections now open) 2015-06-13T04:33:39.289+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:33:39.144+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:33:46.512+0000 I NETWORK [conn981] end connection 10.3.1.100:59402 (5 connections now open) 2015-06-13T04:33:46.512+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59404 #983 (6 connections now open) 2015-06-13T04:34:03.828+0000 I NETWORK [conn982] end connection 10.3.1.102:34679 (5 connections now open) 2015-06-13T04:34:03.828+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34681 #984 (6 connections now open) 2015-06-13T04:34:09.433+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:34:09.289+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:34:16.519+0000 I NETWORK [conn983] end connection 10.3.1.100:59404 (5 connections now open) 2015-06-13T04:34:16.519+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59406 #985 (6 connections now open) 2015-06-13T04:34:33.837+0000 I NETWORK [conn984] end connection 10.3.1.102:34681 (5 connections now open) 2015-06-13T04:34:33.837+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34683 #986 (6 connections now open) 2015-06-13T04:34:39.580+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:34:39.433+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:34:46.527+0000 I NETWORK [conn985] end connection 10.3.1.100:59406 (5 connections now open) 2015-06-13T04:34:46.527+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59408 #987 (6 connections now open) 2015-06-13T04:35:03.849+0000 I NETWORK [conn986] end connection 10.3.1.102:34683 (5 connections now open) 2015-06-13T04:35:03.849+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34685 #988 (6 connections now open) 2015-06-13T04:35:09.723+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:35:09.580+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:35:16.535+0000 I NETWORK [conn987] end connection 10.3.1.100:59408 (5 connections now open) 2015-06-13T04:35:16.535+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59410 #989 (6 connections now open) 2015-06-13T04:35:33.861+0000 I NETWORK [conn988] end connection 10.3.1.102:34685 (5 connections now open) 2015-06-13T04:35:33.861+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34687 #990 (6 connections now open) 2015-06-13T04:35:39.866+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:35:39.724+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:35:46.543+0000 I NETWORK [conn989] end connection 10.3.1.100:59410 (5 connections now open) 2015-06-13T04:35:46.543+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59413 #991 (6 connections now open) 2015-06-13T04:36:03.870+0000 I NETWORK [conn990] end connection 10.3.1.102:34687 (5 connections now open) 2015-06-13T04:36:03.870+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34689 #992 (6 connections now open) 2015-06-13T04:36:10.012+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:36:09.867+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:36:16.553+0000 I NETWORK [conn991] end connection 10.3.1.100:59413 (5 connections now open) 2015-06-13T04:36:16.553+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59415 #993 (6 connections now open) 2015-06-13T04:36:33.875+0000 I NETWORK [conn992] end connection 10.3.1.102:34689 (5 connections now open) 2015-06-13T04:36:33.876+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34691 #994 (6 connections now open) 2015-06-13T04:36:40.154+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:36:40.012+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:36:46.560+0000 I NETWORK [conn993] end connection 10.3.1.100:59415 (5 connections now open) 2015-06-13T04:36:46.561+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59417 #995 (6 connections now open) 2015-06-13T04:37:03.889+0000 I NETWORK [conn994] end connection 10.3.1.102:34691 (5 connections now open) 2015-06-13T04:37:03.889+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34693 #996 (6 connections now open) 2015-06-13T04:37:10.299+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:37:10.154+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:37:16.572+0000 I NETWORK [conn995] end connection 10.3.1.100:59417 (5 connections now open) 2015-06-13T04:37:16.572+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59419 #997 (6 connections now open) 2015-06-13T04:37:33.902+0000 I NETWORK [conn996] end connection 10.3.1.102:34693 (5 connections now open) 2015-06-13T04:37:33.903+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34695 #998 (6 connections now open) 2015-06-13T04:37:40.444+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:37:40.299+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:37:46.581+0000 I NETWORK [conn997] end connection 10.3.1.100:59419 (5 connections now open) 2015-06-13T04:37:46.581+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59421 #999 (6 connections now open) 2015-06-13T04:38:03.914+0000 I NETWORK [conn998] end connection 10.3.1.102:34695 (5 connections now open) 2015-06-13T04:38:03.915+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34697 #1000 (6 connections now open) 2015-06-13T04:38:10.591+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:38:10.444+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:38:16.590+0000 I NETWORK [conn999] end connection 10.3.1.100:59421 (5 connections now open) 2015-06-13T04:38:16.590+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59423 #1001 (6 connections now open) 2015-06-13T04:38:33.923+0000 I NETWORK [conn1000] end connection 10.3.1.102:34697 (5 connections now open) 2015-06-13T04:38:33.923+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34699 #1002 (6 connections now open) 2015-06-13T04:38:40.735+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:38:40.591+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:38:46.597+0000 I NETWORK [conn1001] end connection 10.3.1.100:59423 (5 connections now open) 2015-06-13T04:38:46.597+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59425 #1003 (6 connections now open) 2015-06-13T04:39:03.936+0000 I NETWORK [conn1002] end connection 10.3.1.102:34699 (5 connections now open) 2015-06-13T04:39:03.937+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34701 #1004 (6 connections now open) 2015-06-13T04:39:10.877+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:39:10.735+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:39:16.606+0000 I NETWORK [conn1003] end connection 10.3.1.100:59425 (5 connections now open) 2015-06-13T04:39:16.606+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59427 #1005 (6 connections now open) 2015-06-13T04:39:33.946+0000 I NETWORK [conn1004] end connection 10.3.1.102:34701 (5 connections now open) 2015-06-13T04:39:33.946+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34703 #1006 (6 connections now open) 2015-06-13T04:39:41.021+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:39:40.878+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:39:46.614+0000 I NETWORK [conn1005] end connection 10.3.1.100:59427 (5 connections now open) 2015-06-13T04:39:46.614+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59429 #1007 (6 connections now open) 2015-06-13T04:40:03.955+0000 I NETWORK [conn1006] end connection 10.3.1.102:34703 (5 connections now open) 2015-06-13T04:40:03.955+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34705 #1008 (6 connections now open) 2015-06-13T04:40:11.163+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:40:11.021+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:40:16.624+0000 I NETWORK [conn1007] end connection 10.3.1.100:59429 (5 connections now open) 2015-06-13T04:40:16.624+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59431 #1009 (6 connections now open) 2015-06-13T04:40:33.965+0000 I NETWORK [conn1008] end connection 10.3.1.102:34705 (5 connections now open) 2015-06-13T04:40:33.965+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34707 #1010 (6 connections now open) 2015-06-13T04:40:41.341+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:40:41.164+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:40:46.632+0000 I NETWORK [conn1009] end connection 10.3.1.100:59431 (5 connections now open) 2015-06-13T04:40:46.632+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59433 #1011 (6 connections now open) 2015-06-13T04:41:03.977+0000 I NETWORK [conn1010] end connection 10.3.1.102:34707 (5 connections now open) 2015-06-13T04:41:03.978+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34709 #1012 (6 connections now open) 2015-06-13T04:41:11.589+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:41:11.341+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:41:16.643+0000 I NETWORK [conn1011] end connection 10.3.1.100:59433 (5 connections now open) 2015-06-13T04:41:16.644+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59435 #1013 (6 connections now open) 2015-06-13T04:41:33.986+0000 I NETWORK [conn1012] end connection 10.3.1.102:34709 (5 connections now open) 2015-06-13T04:41:33.986+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34711 #1014 (6 connections now open) 2015-06-13T04:41:41.833+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:41:41.590+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:41:46.653+0000 I NETWORK [conn1013] end connection 10.3.1.100:59435 (5 connections now open) 2015-06-13T04:41:46.653+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59437 #1015 (6 connections now open) 2015-06-13T04:42:03.997+0000 I NETWORK [conn1014] end connection 10.3.1.102:34711 (5 connections now open) 2015-06-13T04:42:03.997+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34713 #1016 (6 connections now open) 2015-06-13T04:42:12.010+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:42:11.834+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:42:16.659+0000 I NETWORK [conn1015] end connection 10.3.1.100:59437 (5 connections now open) 2015-06-13T04:42:16.660+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59439 #1017 (6 connections now open) 2015-06-13T04:42:34.006+0000 I NETWORK [conn1016] end connection 10.3.1.102:34713 (5 connections now open) 2015-06-13T04:42:34.007+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34715 #1018 (6 connections now open) 2015-06-13T04:42:42.222+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:42:42.010+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:42:46.667+0000 I NETWORK [conn1017] end connection 10.3.1.100:59439 (5 connections now open) 2015-06-13T04:42:46.668+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59441 #1019 (6 connections now open) 2015-06-13T04:43:04.020+0000 I NETWORK [conn1018] end connection 10.3.1.102:34715 (5 connections now open) 2015-06-13T04:43:04.020+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34717 #1020 (6 connections now open) 2015-06-13T04:43:12.433+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:43:12.222+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:43:16.677+0000 I NETWORK [conn1019] end connection 10.3.1.100:59441 (5 connections now open) 2015-06-13T04:43:16.677+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59443 #1021 (6 connections now open) 2015-06-13T04:43:34.031+0000 I NETWORK [conn1020] end connection 10.3.1.102:34717 (5 connections now open) 2015-06-13T04:43:34.031+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34719 #1022 (6 connections now open) 2015-06-13T04:43:42.577+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:43:42.433+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:43:46.684+0000 I NETWORK [conn1021] end connection 10.3.1.100:59443 (5 connections now open) 2015-06-13T04:43:46.684+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59445 #1023 (6 connections now open) 2015-06-13T04:44:04.044+0000 I NETWORK [conn1022] end connection 10.3.1.102:34719 (5 connections now open) 2015-06-13T04:44:04.044+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34721 #1024 (6 connections now open) 2015-06-13T04:44:12.719+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:44:12.577+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:44:16.690+0000 I NETWORK [conn1023] end connection 10.3.1.100:59445 (5 connections now open) 2015-06-13T04:44:16.690+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59447 #1025 (6 connections now open) 2015-06-13T04:44:34.055+0000 I NETWORK [conn1024] end connection 10.3.1.102:34721 (5 connections now open) 2015-06-13T04:44:34.055+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34723 #1026 (6 connections now open) 2015-06-13T04:44:42.966+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:44:42.720+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:44:46.700+0000 I NETWORK [conn1025] end connection 10.3.1.100:59447 (5 connections now open) 2015-06-13T04:44:46.700+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59449 #1027 (6 connections now open) 2015-06-13T04:45:04.066+0000 I NETWORK [conn1026] end connection 10.3.1.102:34723 (5 connections now open) 2015-06-13T04:45:04.066+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34725 #1028 (6 connections now open) 2015-06-13T04:45:13.142+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:45:12.966+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:45:16.709+0000 I NETWORK [conn1027] end connection 10.3.1.100:59449 (5 connections now open) 2015-06-13T04:45:16.709+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59451 #1029 (6 connections now open) 2015-06-13T04:45:34.078+0000 I NETWORK [conn1028] end connection 10.3.1.102:34725 (5 connections now open) 2015-06-13T04:45:34.078+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34727 #1030 (6 connections now open) 2015-06-13T04:45:43.318+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:45:43.142+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:45:46.718+0000 I NETWORK [conn1029] end connection 10.3.1.100:59451 (5 connections now open) 2015-06-13T04:45:46.719+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59453 #1031 (6 connections now open) 2015-06-13T04:46:04.086+0000 I NETWORK [conn1030] end connection 10.3.1.102:34727 (5 connections now open) 2015-06-13T04:46:04.087+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34729 #1032 (6 connections now open) 2015-06-13T04:46:13.566+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:46:13.318+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:46:16.725+0000 I NETWORK [conn1031] end connection 10.3.1.100:59453 (5 connections now open) 2015-06-13T04:46:16.726+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59455 #1033 (6 connections now open) 2015-06-13T04:46:34.094+0000 I NETWORK [conn1032] end connection 10.3.1.102:34729 (5 connections now open) 2015-06-13T04:46:34.094+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34731 #1034 (6 connections now open) 2015-06-13T04:46:43.814+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:46:43.566+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:46:46.734+0000 I NETWORK [conn1033] end connection 10.3.1.100:59455 (5 connections now open) 2015-06-13T04:46:46.734+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59457 #1035 (6 connections now open) 2015-06-13T04:47:04.106+0000 I NETWORK [conn1034] end connection 10.3.1.102:34731 (5 connections now open) 2015-06-13T04:47:04.106+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34733 #1036 (6 connections now open) 2015-06-13T04:47:13.936+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:47:13.814+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:47:16.742+0000 I NETWORK [conn1035] end connection 10.3.1.100:59457 (5 connections now open) 2015-06-13T04:47:16.742+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59459 #1037 (6 connections now open) 2015-06-13T04:47:34.114+0000 I NETWORK [conn1036] end connection 10.3.1.102:34733 (5 connections now open) 2015-06-13T04:47:34.114+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34735 #1038 (6 connections now open) 2015-06-13T04:47:44.082+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:47:43.936+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:47:46.749+0000 I NETWORK [conn1037] end connection 10.3.1.100:59459 (5 connections now open) 2015-06-13T04:47:46.750+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59461 #1039 (6 connections now open) 2015-06-13T04:48:04.126+0000 I NETWORK [conn1038] end connection 10.3.1.102:34735 (5 connections now open) 2015-06-13T04:48:04.126+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34737 #1040 (6 connections now open) 2015-06-13T04:48:14.270+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:48:14.082+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:48:16.756+0000 I NETWORK [conn1039] end connection 10.3.1.100:59461 (5 connections now open) 2015-06-13T04:48:16.757+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59463 #1041 (6 connections now open) 2015-06-13T04:48:34.140+0000 I NETWORK [conn1040] end connection 10.3.1.102:34737 (5 connections now open) 2015-06-13T04:48:34.140+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34739 #1042 (6 connections now open) 2015-06-13T04:48:44.397+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:48:44.270+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:48:46.767+0000 I NETWORK [conn1041] end connection 10.3.1.100:59463 (5 connections now open) 2015-06-13T04:48:46.767+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59465 #1043 (6 connections now open) 2015-06-13T04:49:04.151+0000 I NETWORK [conn1042] end connection 10.3.1.102:34739 (5 connections now open) 2015-06-13T04:49:04.151+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34741 #1044 (6 connections now open) 2015-06-13T04:49:14.542+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:49:14.397+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:49:16.775+0000 I NETWORK [conn1043] end connection 10.3.1.100:59465 (5 connections now open) 2015-06-13T04:49:16.775+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59467 #1045 (6 connections now open) 2015-06-13T04:49:34.160+0000 I NETWORK [conn1044] end connection 10.3.1.102:34741 (5 connections now open) 2015-06-13T04:49:34.161+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34743 #1046 (6 connections now open) 2015-06-13T04:49:44.689+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:49:44.542+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:49:46.783+0000 I NETWORK [conn1045] end connection 10.3.1.100:59467 (5 connections now open) 2015-06-13T04:49:46.783+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59469 #1047 (6 connections now open) 2015-06-13T04:50:04.172+0000 I NETWORK [conn1046] end connection 10.3.1.102:34743 (5 connections now open) 2015-06-13T04:50:04.172+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34745 #1048 (6 connections now open) 2015-06-13T04:50:14.832+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:50:14.689+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:50:16.795+0000 I NETWORK [conn1047] end connection 10.3.1.100:59469 (5 connections now open) 2015-06-13T04:50:16.795+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59471 #1049 (6 connections now open) 2015-06-13T04:50:34.186+0000 I NETWORK [conn1048] end connection 10.3.1.102:34745 (5 connections now open) 2015-06-13T04:50:34.186+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34748 #1050 (6 connections now open) 2015-06-13T04:50:44.974+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:50:44.832+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:50:46.807+0000 I NETWORK [conn1049] end connection 10.3.1.100:59471 (5 connections now open) 2015-06-13T04:50:46.808+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59473 #1051 (6 connections now open) 2015-06-13T04:51:04.198+0000 I NETWORK [conn1050] end connection 10.3.1.102:34748 (5 connections now open) 2015-06-13T04:51:04.198+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34750 #1052 (6 connections now open) 2015-06-13T04:51:15.117+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:51:14.974+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:51:16.815+0000 I NETWORK [conn1051] end connection 10.3.1.100:59473 (5 connections now open) 2015-06-13T04:51:16.815+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59475 #1053 (6 connections now open) 2015-06-13T04:51:34.211+0000 I NETWORK [conn1052] end connection 10.3.1.102:34750 (5 connections now open) 2015-06-13T04:51:34.211+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34752 #1054 (6 connections now open) 2015-06-13T04:51:45.262+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:51:45.117+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:51:46.823+0000 I NETWORK [conn1053] end connection 10.3.1.100:59475 (5 connections now open) 2015-06-13T04:51:46.823+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59477 #1055 (6 connections now open) 2015-06-13T04:52:04.223+0000 I NETWORK [conn1054] end connection 10.3.1.102:34752 (5 connections now open) 2015-06-13T04:52:04.223+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.102:34754 #1056 (6 connections now open) 2015-06-13T04:52:15.405+0000 I SHARDING [LockPinger] cluster 10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019 pinged successfully at 2015-06-13T04:52:15.262+0000 by distributed lock pinger '10.3.1.81:27019,10.3.1.82:27019,10.3.1.83:27019/ip-10-3-1-101:27017:1434159578:1206341455', sleeping for 30000ms 2015-06-13T04:52:16.833+0000 I NETWORK [conn1055] end connection 10.3.1.100:59477 (5 connections now open) 2015-06-13T04:52:16.834+0000 I NETWORK [initandlisten] connection accepted from 10.3.1.100:59479 #1057 (6 connections now open)