2013-10-22T20:09:29.607+0000 BackgroundJob starting: DataFileSync 2013-10-22T20:09:29.607+0000 versionArrayTest passed 2013-10-22T20:09:29.608+0000 shardKeyTest passed 2013-10-22T20:09:29.608+0000 isInRangeTest passed 2013-10-22T20:09:29.608+0000 shardObjTest passed 2013-10-22T20:09:29.609+0000 [initandlisten] MongoDB starting : pid=2476 port=27017 dbpath=/data/rs2 64-bit host=ip-10-234-11-233 2013-10-22T20:09:29.609+0000 [initandlisten] 2013-10-22T20:09:29.609+0000 [initandlisten] ** NOTE: This is a development version (2.5.3) of MongoDB. 2013-10-22T20:09:29.609+0000 [initandlisten] ** Not recommended for production. 2013-10-22T20:09:29.610+0000 [initandlisten] 2013-10-22T20:09:29.610+0000 [initandlisten] db version v2.5.3 2013-10-22T20:09:29.610+0000 [initandlisten] git version: 78a5cc81af2209e10e1357a41e02f1689b60ef1e modules: subscription 2013-10-22T20:09:29.610+0000 [initandlisten] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2013-10-22T20:09:29.610+0000 [initandlisten] build info: Linux bs-e-amzn64 3.2.12-3.2.4.amzn1.x86_64 #1 SMP Thu Mar 22 08:00:08 UTC 2012 x86_64 BOOST_LIB_VERSION=1_49 2013-10-22T20:09:29.610+0000 [initandlisten] allocator: tcmalloc 2013-10-22T20:09:29.610+0000 [initandlisten] options: { dbpath: "/data/rs2", fork: true, logpath: "/var/log/mongodb/2.log", oplogSize: 200, port: 27017, replSet: "set1", smallfiles: true, snmp-subagent: true, vvvvv: true } 2013-10-22T20:09:29.615+0000 [initandlisten] flushing directory /data/rs2 2013-10-22T20:09:29.622+0000 BackgroundJob starting: SNMPAgent 2013-10-22T20:09:29.622+0000 [initandlisten] journal dir=/data/rs2/journal 2013-10-22T20:09:29.622+0000 [initandlisten] recover : no journal files present, no recovery needed 2013-10-22T20:09:29.622+0000 [initandlisten] flushing directory /data/rs2/journal 2013-10-22T20:09:29.624+0000 [SnmpAgent] SNMPAgent num things: 95 2013-10-22T20:09:29.627+0000 [initandlisten] flushing directory /data/rs2/journal 2013-10-22T20:09:29.632+0000 [initandlisten] enter repairDatabases (to check pdfile version #) 2013-10-22T20:09:29.632+0000 [initandlisten] local 2013-10-22T20:09:29.632+0000 [initandlisten] opening db: local 2013-10-22T20:09:29.632+0000 [initandlisten] mmf open /data/rs2/local.ns 2013-10-22T20:09:29.632+0000 [initandlisten] mmf finishOpening 0x7f8ca439e000 /data/rs2/local.ns len:16777216 2013-10-22T20:09:29.632+0000 [initandlisten] mmf open /data/rs2/local.0 2013-10-22T20:09:29.632+0000 [initandlisten] mmf finishOpening 0x7f8ca239e000 /data/rs2/local.0 len:16777216 2013-10-22T20:09:29.632+0000 [initandlisten] mmf open /data/rs2/local.1 2013-10-22T20:09:29.632+0000 [initandlisten] mmf finishOpening 0x7f8c9139e000 /data/rs2/local.1 len:268435456 2013-10-22T20:09:29.634+0000 [initandlisten] mmf close /data/rs2/local.0 2013-10-22T20:09:29.634+0000 [initandlisten] _groupCommit 2013-10-22T20:09:29.634+0000 [initandlisten] journal REMAPPRIVATEVIEW 2013-10-22T20:09:29.634+0000 [initandlisten] journal REMAPPRIVATEVIEW done startedAt: 0 n:3 0ms 2013-10-22T20:09:29.634+0000 [initandlisten] groupCommit end 2013-10-22T20:09:29.637+0000 [initandlisten] mmf close /data/rs2/local.1 2013-10-22T20:09:29.637+0000 [initandlisten] _groupCommit 2013-10-22T20:09:29.637+0000 [initandlisten] journal REMAPPRIVATEVIEW 2013-10-22T20:09:29.637+0000 [initandlisten] journal REMAPPRIVATEVIEW done startedAt: 0 n:1 0ms 2013-10-22T20:09:29.637+0000 [initandlisten] groupCommit end 2013-10-22T20:09:29.637+0000 [initandlisten] mmf close /data/rs2/local.ns 2013-10-22T20:09:29.637+0000 [initandlisten] _groupCommit 2013-10-22T20:09:29.637+0000 [initandlisten] journal REMAPPRIVATEVIEW 2013-10-22T20:09:29.637+0000 [initandlisten] journal REMAPPRIVATEVIEW done startedAt: 1 n:1 0ms 2013-10-22T20:09:29.637+0000 [initandlisten] groupCommit end 2013-10-22T20:09:29.638+0000 [initandlisten] done repairDatabases 2013-10-22T20:09:29.638+0000 [initandlisten] runQuery called admin.system.roles {} 2013-10-22T20:09:29.638+0000 [initandlisten] opening db: admin 2013-10-22T20:09:29.638+0000 [initandlisten] query admin.system.roles ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) W:104 r:109 nreturned:0 reslen:20 0ms 2013-10-22T20:09:29.640+0000 [initandlisten] fd limit hard:4096 soft:1024 max conn: 819 2013-10-22T20:09:29.641+0000 [initandlisten] runQuery called local.$cmd { create: "startup_log", size: 10485760, capped: true } 2013-10-22T20:09:29.641+0000 [initandlisten] run command local.$cmd { create: "startup_log", size: 10485760, capped: true } 2013-10-22T20:09:29.641+0000 [initandlisten] opening db: local 2013-10-22T20:09:29.641+0000 [initandlisten] mmf open /data/rs2/local.ns 2013-10-22T20:09:29.641+0000 [initandlisten] mmf finishOpening 0x7f8ca1398000 /data/rs2/local.ns len:16777216 2013-10-22T20:09:29.641+0000 [initandlisten] mmf open /data/rs2/local.0 2013-10-22T20:09:29.641+0000 [initandlisten] mmf finishOpening 0x7f8c9f398000 /data/rs2/local.0 len:16777216 2013-10-22T20:09:29.641+0000 [initandlisten] mmf open /data/rs2/local.1 2013-10-22T20:09:29.641+0000 [initandlisten] mmf finishOpening 0x7f8c8e398000 /data/rs2/local.1 len:268435456 2013-10-22T20:09:29.643+0000 [initandlisten] create collection local.startup_log { create: "startup_log", size: 10485760, capped: true } 2013-10-22T20:09:29.643+0000 [initandlisten] command local.$cmd command: { create: "startup_log", size: 10485760, capped: true } ntoreturn:1 keyUpdates:0 reslen:75 2ms 2013-10-22T20:09:29.643+0000 [initandlisten] info PageFaultRetryableSection will not yield, already locked upon reaching 2013-10-22T20:09:29.643+0000 [initandlisten] insert local.startup_log ninserted:1 keyUpdates:0 0ms 2013-10-22T20:09:29.643+0000 [initandlisten] waiting for connections on port 27017 2013-10-22T20:09:29.644+0000 BackgroundJob starting: IndexRebuilder 2013-10-22T20:09:29.644+0000 [IndexRebuilder] runQuery called local.system.namespaces {} 2013-10-22T20:09:29.644+0000 [IndexRebuilder] query local.system.namespaces ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) r:153 nreturned:10 reslen:465 0ms 2013-10-22T20:09:29.644+0000 [IndexRebuilder] checking complete 2013-10-22T20:09:29.644+0000 BackgroundJob starting: PeriodicTask::Runner 2013-10-22T20:09:29.645+0000 BackgroundJob starting: snapshot 2013-10-22T20:09:29.645+0000 BackgroundJob starting: TTLMonitor 2013-10-22T20:09:29.645+0000 BackgroundJob starting: ClientCursorMonitor 2013-10-22T20:09:29.647+0000 [rsStart] replSet beginning startup... 2013-10-22T20:09:29.647+0000 [rsStart] loadConfig() local.system.replset 2013-10-22T20:09:29.647+0000 [rsStart] runQuery called local.system.replset {} 2013-10-22T20:09:29.647+0000 [rsStart] query local.system.replset ntoreturn:1 ntoskip:0 keyUpdates:0 locks(micros) r:84 nreturned:1 reslen:207 0ms 2013-10-22T20:09:29.648+0000 [rsStart] getMyAddrs(): [127.0.0.1] [10.234.11.233] [::1] [fe80::2000:aff:feea:be9%eth0] 2013-10-22T20:09:29.648+0000 [rsStart] getallIPs("10.234.11.233"): [10.234.11.233] 2013-10-22T20:09:29.648+0000 [rsStart] replSet I am 10.234.11.233:27017 2013-10-22T20:09:29.648+0000 [rsStart] replSet STARTUP2 2013-10-22T20:09:29.649+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:29.649+0000 BackgroundJob starting: rsHealthPoll 2013-10-22T20:09:29.650+0000 BackgroundJob starting: rsGhostSync 2013-10-22T20:09:29.650+0000 BackgroundJob starting: rsHealthPoll 2013-10-22T20:09:29.651+0000 BackgroundJob starting: SyncSourceFeedbackThread 2013-10-22T20:09:29.651+0000 [rsSync] replSet SECONDARY 2013-10-22T20:09:29.651+0000 BackgroundJob starting: rsMgr 2013-10-22T20:09:29.651+0000 [rsBackgroundSync] replset bgsync fetch queue set to: 5266db0e:1 -818463724904958869 2013-10-22T20:09:29.651+0000 [rsMgr] replSet can't see a majority, will not try to elect self 2013-10-22T20:09:29.651+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.652+0000 [rsHealthPoll] replset info 10.234.11.233:27016 thinks that we are down 2013-10-22T20:09:29.652+0000 [rsHealthPoll] replSet member 10.234.11.233:27016 is up 2013-10-22T20:09:29.652+0000 [rsHealthPoll] replSet member 10.234.11.233:27016 is now in state SECONDARY 2013-10-22T20:09:29.652+0000 BackgroundJob starting: MultiCommandJob 2013-10-22T20:09:29.652+0000 BackgroundJob starting: MultiCommandJob 2013-10-22T20:09:29.654+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.654+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.654+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.654+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:29.654+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.654+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.654+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.655+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:29.655+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.655+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.656+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.656+0000 [rsHealthPoll] replset info 10.234.11.233:27018 heartbeat failed, retrying 2013-10-22T20:09:29.656+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.656+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.656+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.656+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:29.656+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.657+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.657+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.659+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:29.659+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.659+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.659+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.659+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.659+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.659+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.659+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:29.659+0000 [rsHealthPoll] replSet info 10.234.11.233:27018 is down (or slow to respond): 2013-10-22T20:09:29.659+0000 [rsHealthPoll] replSet member 10.234.11.233:27018 is now in state DOWN 2013-10-22T20:09:29.660+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.660+0000 [MultiCommandJob] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.660+0000 [MultiCommandJob] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.664+0000 [MultiCommandJob] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:29.664+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:29.664+0000 [MultiCommandJob] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:29.664+0000 [MultiCommandJob] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:29.664+0000 [rsMgr] not electing self, 10.234.11.233:27016 would veto with 'I don't think 10.234.11.233:27017 is electable' 2013-10-22T20:09:29.664+0000 BackgroundJob starting: MultiCommandJob 2013-10-22T20:09:29.665+0000 [rsMgr] not electing self, 10.234.11.233:27016 would veto with 'I don't think 10.234.11.233:27017 is electable' 2013-10-22T20:09:29.714+0000 [SnmpAgent] SNMPAgent running as subagent 2013-10-22T20:09:29.741+0000 [journal] journal WRITETODATAFILES 1 2013-10-22T20:09:29.741+0000 [journal] journal WRITETODATAFILES 2 2013-10-22T20:09:29.741+0000 [journal] journal WRITETODATAFILES 0.191ms 2013-10-22T20:09:30.149+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:30.649+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:30.661+0000 [journal] _groupCommit 2013-10-22T20:09:30.661+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:30.661+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:30.661+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:30.661+0000 [journal] groupCommit end 2013-10-22T20:09:31.035+0000 [initandlisten] connection accepted from 10.234.11.233:54565 #1 (1 connection now open) 2013-10-22T20:09:31.149+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:31.649+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:31.652+0000 [rsHealthPoll] replset info 10.234.11.233:27016 thinks that we are down 2013-10-22T20:09:31.660+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.660+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.660+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.660+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:31.660+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.660+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.660+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.668+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:31.668+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.669+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.669+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.669+0000 [rsHealthPoll] replset info 10.234.11.233:27018 heartbeat failed, retrying 2013-10-22T20:09:31.669+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.669+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.669+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.669+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:31.669+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.669+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.669+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.684+0000 [journal] _groupCommit 2013-10-22T20:09:31.684+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:31.684+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:31.684+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:31.684+0000 [journal] groupCommit end 2013-10-22T20:09:31.685+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:31.686+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.686+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.686+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.686+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:31.686+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:31.686+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:31.686+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:32.036+0000 [conn1] Socket recv() conn closed? 10.234.11.233:54565 2013-10-22T20:09:32.036+0000 [conn1] SocketException: remote: 10.234.11.233:54565 error: 9001 socket exception [CLOSED] server [10.234.11.233:54565] 2013-10-22T20:09:32.036+0000 [initandlisten] connection accepted from 10.234.11.233:54576 #2 (2 connections now open) 2013-10-22T20:09:32.036+0000 [conn1] end connection 10.234.11.233:54565 (0 connections now open) 2013-10-22T20:09:32.036+0000 [conn2] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:32.036+0000 [conn2] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:32.036+0000 [conn2] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:32.036+0000 [conn2] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:32.037+0000 [conn2] runQuery called admin.$cmd { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:32.037+0000 [conn2] run command admin.$cmd { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:32.037+0000 [conn2] command: { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:32.037+0000 [conn2] command admin.$cmd command: { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } ntoreturn:1 keyUpdates:0 reslen:129 0ms 2013-10-22T20:09:32.149+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:32.650+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:32.706+0000 [journal] _groupCommit 2013-10-22T20:09:32.706+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:32.706+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:32.706+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:32.706+0000 [journal] groupCommit end 2013-10-22T20:09:33.150+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:33.650+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:33.686+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.686+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.687+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.687+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:33.687+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.687+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.687+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.719+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:33.719+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.719+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.719+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.719+0000 [rsHealthPoll] replset info 10.234.11.233:27018 heartbeat failed, retrying 2013-10-22T20:09:33.719+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.720+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.720+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.720+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:33.720+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.720+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.720+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.728+0000 [journal] _groupCommit 2013-10-22T20:09:33.728+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:33.728+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:33.728+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:33.728+0000 [journal] groupCommit end 2013-10-22T20:09:33.784+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:33.784+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.784+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.784+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.785+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:33.785+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:33.785+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:33.785+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:34.037+0000 [conn2] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:34.037+0000 [conn2] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:34.037+0000 [conn2] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:34.037+0000 [conn2] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:34.150+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:34.650+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:34.751+0000 [journal] _groupCommit 2013-10-22T20:09:34.751+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:34.751+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:34.751+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:34.751+0000 [journal] groupCommit end 2013-10-22T20:09:35.150+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:35.650+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:35.654+0000 BackgroundJob starting: MultiCommandJob 2013-10-22T20:09:35.654+0000 [rsMgr] replSet dev we are freshest of up nodes, nok:1 nTies:1 2013-10-22T20:09:35.654+0000 [rsMgr] replSet info electSelf 0 2013-10-22T20:09:35.654+0000 BackgroundJob starting: MultiCommandJob 2013-10-22T20:09:35.655+0000 [rsMgr] replSet election succeeded, assuming primary role 2013-10-22T20:09:35.655+0000 [rsMgr] replSet assuming primary 2013-10-22T20:09:35.655+0000 [rsMgr] replSet waiting for replication to finish before becoming primary 2013-10-22T20:09:35.773+0000 [journal] _groupCommit 2013-10-22T20:09:35.773+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:35.773+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:35.773+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:35.773+0000 [journal] groupCommit end 2013-10-22T20:09:35.785+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:35.785+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:35.785+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:35.785+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:35.785+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:35.785+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:35.785+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:35.914+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:35.914+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:35.914+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:35.914+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:35.914+0000 [rsHealthPoll] replset info 10.234.11.233:27018 heartbeat failed, retrying 2013-10-22T20:09:35.914+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:35.914+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:35.914+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:35.914+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:35.914+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:35.914+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:35.915+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:36.037+0000 [conn2] Socket recv() conn closed? 10.234.11.233:54576 2013-10-22T20:09:36.037+0000 [conn2] SocketException: remote: 10.234.11.233:54576 error: 9001 socket exception [CLOSED] server [10.234.11.233:54576] 2013-10-22T20:09:36.037+0000 [conn2] end connection 10.234.11.233:54576 (0 connections now open) 2013-10-22T20:09:36.038+0000 [initandlisten] connection accepted from 10.234.11.233:54598 #3 (1 connection now open) 2013-10-22T20:09:36.038+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:36.038+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:36.038+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:36.038+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:36.151+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:36.171+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:36.171+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:36.171+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:36.171+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:36.171+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:36.171+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:36.171+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:36.171+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:36.651+0000 [rsSyncNotifier] replset markOplog: 0:0 5266db0e:1 2013-10-22T20:09:36.652+0000 [rsMgr] runQuery called local.oplog.rs { query: {}, orderby: { $natural: -1 } } 2013-10-22T20:09:36.652+0000 [rsMgr] query local.oplog.rs query: { query: {}, orderby: { $natural: -1 } } ntoreturn:1 ntoskip:0 keyUpdates:0 nreturned:1 reslen:117 0ms 2013-10-22T20:09:36.652+0000 [rsMgr] replSet PRIMARY 2013-10-22T20:09:36.795+0000 [journal] _groupCommit 2013-10-22T20:09:36.795+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:36.795+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:36.795+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:36.795+0000 [journal] groupCommit end 2013-10-22T20:09:37.056+0000 [conn3] runQuery called admin.$cmd { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:37.056+0000 [conn3] run command admin.$cmd { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:37.056+0000 [conn3] command: { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } 2013-10-22T20:09:37.056+0000 [conn3] command admin.$cmd command: { replSetFresh: 1, set: "set1", opTime: new Date(5937674011910602753), who: "10.234.11.233:27016", cfgver: 9, id: 2 } ntoreturn:1 keyUpdates:0 reslen:161 0ms 2013-10-22T20:09:37.817+0000 [journal] _groupCommit 2013-10-22T20:09:37.817+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:37.817+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:37.817+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:37.817+0000 [journal] groupCommit end 2013-10-22T20:09:38.038+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:38.038+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:38.038+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:38.038+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:38.172+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:38.172+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:38.172+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:38.172+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:38.172+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:38.172+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:38.172+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:38.684+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:38.684+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:38.684+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:38.684+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 failed couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:38.685+0000 [rsHealthPoll] replset info 10.234.11.233:27018 heartbeat failed, retrying 2013-10-22T20:09:38.685+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:38.685+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:38.685+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:38.685+0000 [rsHealthPoll] unable to set SO_RCVTIMEO 2013-10-22T20:09:38.685+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:38.685+0000 [rsHealthPoll] warning: Failed to connect to 10.234.11.233, reason: errno:111 Connection refused 2013-10-22T20:09:38.685+0000 [rsHealthPoll] couldn't connect to 10.234.11.233:27018: couldn't connect to server 10.234.11.233:27018 2013-10-22T20:09:38.840+0000 [journal] _groupCommit 2013-10-22T20:09:38.840+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:38.840+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:38.840+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:38.840+0000 [journal] groupCommit end 2013-10-22T20:09:39.471+0000 [initandlisten] connection accepted from 10.234.11.233:54621 #4 (2 connections now open) 2013-10-22T20:09:39.471+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:39.471+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:39.471+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:39.471+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:140 0ms 2013-10-22T20:09:39.685+0000 [rsHealthPoll] trying reconnect to 10.234.11.233:27018 2013-10-22T20:09:39.685+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:39.686+0000 [rsHealthPoll] reconnect 10.234.11.233:27018 ok 2013-10-22T20:09:39.686+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:39.687+0000 [rsHealthPoll] replSet member 10.234.11.233:27018 is up 2013-10-22T20:09:39.687+0000 [rsHealthPoll] replSet member 10.234.11.233:27018 is now in state SECONDARY 2013-10-22T20:09:39.862+0000 [journal] _groupCommit 2013-10-22T20:09:39.862+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:39.862+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:39.862+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:39.862+0000 [journal] groupCommit end 2013-10-22T20:09:40.039+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:40.039+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:40.039+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:40.039+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:40.885+0000 [journal] _groupCommit 2013-10-22T20:09:40.885+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:40.885+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:40.885+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:40.885+0000 [journal] groupCommit end 2013-10-22T20:09:41.472+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:41.472+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:41.472+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:41.472+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:41.907+0000 [journal] _groupCommit 2013-10-22T20:09:41.907+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:41.907+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:41.907+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:41.907+0000 [journal] groupCommit end 2013-10-22T20:09:41.998+0000 [initandlisten] connection accepted from 10.234.11.233:54627 #5 (3 connections now open) 2013-10-22T20:09:41.998+0000 [conn5] runQuery called local.oplog.rs {} 2013-10-22T20:09:41.998+0000 [conn5] query local.oplog.rs ntoreturn:1 ntoskip:0 keyUpdates:0 locks(micros) r:95 nreturned:1 reslen:106 0ms 2013-10-22T20:09:41.999+0000 [initandlisten] connection accepted from 10.234.11.233:54628 #6 (4 connections now open) 2013-10-22T20:09:41.999+0000 [conn6] runQuery called admin.$cmd { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c00213a2cc9a81f3be1c'), member: 2, config: { _id: 2, host: "10.234.11.233:27016" } } } 2013-10-22T20:09:41.999+0000 [conn6] run command admin.$cmd { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c00213a2cc9a81f3be1c'), member: 2, config: { _id: 2, host: "10.234.11.233:27016" } } } 2013-10-22T20:09:41.999+0000 [conn6] command: { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c00213a2cc9a81f3be1c'), member: 2, config: { _id: 2, host: "10.234.11.233:27016" } } } 2013-10-22T20:09:41.999+0000 [conn6] command admin.$cmd command: { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c00213a2cc9a81f3be1c'), member: 2, config: { _id: 2, host: "10.234.11.233:27016" } } } ntoreturn:1 keyUpdates:0 reslen:37 0ms 2013-10-22T20:09:41.999+0000 [conn5] runQuery called local.oplog.rs { ts: { $gte: Timestamp 1382472462000|1 } } 2013-10-22T20:09:42.001+0000 [conn5] query local.oplog.rs query: { ts: { $gte: Timestamp 1382472462000|1 } } cursorid:52684169410786 ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) r:1310 nreturned:1 reslen:117 1ms 2013-10-22T20:09:42.003+0000 [conn6] runQuery called admin.$cmd { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c00213a2cc9a81f3be1c'), optime: Timestamp 1382472462000|1, config: { _id: 2, host: "10.234.11.233:27016" } } ] } 2013-10-22T20:09:42.003+0000 [conn6] run command admin.$cmd { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c00213a2cc9a81f3be1c'), optime: Timestamp 1382472462000|1, config: { _id: 2, host: "10.234.11.233:27016" } } ] } 2013-10-22T20:09:42.003+0000 [conn6] command: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c00213a2cc9a81f3be1c'), optime: Timestamp 1382472462000|1, config: { _id: 2, host: "10.234.11.233:27016" } } ] } 2013-10-22T20:09:42.003+0000 [conn6] command admin.$cmd command: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c00213a2cc9a81f3be1c'), optime: Timestamp 1382472462000|1, config: { _id: 2, host: "10.234.11.233:27016" } } ] } ntoreturn:1 keyUpdates:0 reslen:37 0ms 2013-10-22T20:09:42.003+0000 BackgroundJob starting: SlaveTracking 2013-10-22T20:09:42.039+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:42.039+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:42.039+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:42.039+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:42.930+0000 [journal] _groupCommit 2013-10-22T20:09:42.930+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:42.930+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:42.930+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:42.930+0000 [journal] groupCommit end 2013-10-22T20:09:43.004+0000 [slaveTracking] processing update : query: { _id: ObjectId('5266c00213a2cc9a81f3be1c'), config: { _id: 2, host: "10.234.11.233:27016" }, ns: "local.oplog.rs" } updated: { $set: { syncedTo: Timestamp 1382472462000|1 } } god: 0 upsert: 1 multi: 0 logToOplog: 1 fromMigration: 0 fromReplications: 0 2013-10-22T20:09:43.004+0000 [slaveTracking] running multiple plans 2013-10-22T20:09:43.004+0000 [slaveTracking] CoveredIndexMatcher::matches() { : ObjectId('5266c00213a2cc9a81f3be1c') } 1:c80c140 1 2013-10-22T20:09:43.004+0000 [slaveTracking] CoveredIndexMatcher _docMatcher->matches() returns 0 2013-10-22T20:09:43.004+0000 [slaveTracking] CoveredIndexMatcher::matches() {} 1:c80c0b0 0 2013-10-22T20:09:43.004+0000 [slaveTracking] CoveredIndexMatcher _docMatcher->matches() returns 0 2013-10-22T20:09:43.005+0000 [slaveTracking] User Assertion: 11000:E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } 2013-10-22T20:09:43.005+0000 [slaveTracking] User Assertion: 11000:E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } 2013-10-22T20:09:43.005+0000 [slaveTracking] update local.slaves query: { _id: ObjectId('5266c00213a2cc9a81f3be1c'), config: { _id: 2, host: "10.234.11.233:27016" }, ns: "local.oplog.rs" } update: { $set: { syncedTo: Timestamp 1382472462000|1 } } nscanned:2 fastmodinsert:1 upsert:1 keyUpdates:0 exception: E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } code:11000 locks(micros) w:1632 1ms 2013-10-22T20:09:43.034+0000 [journal] journal WRITETODATAFILES 1 2013-10-22T20:09:43.034+0000 [journal] journal WRITETODATAFILES 2 2013-10-22T20:09:43.034+0000 [journal] journal WRITETODATAFILES 0.164ms 2013-10-22T20:09:43.472+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:43.472+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:43.472+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:43.472+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:43.954+0000 [journal] _groupCommit 2013-10-22T20:09:43.954+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:43.954+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:43.955+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:43.955+0000 [journal] groupCommit end 2013-10-22T20:09:44.040+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:44.040+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:44.040+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:44.040+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:44.475+0000 [initandlisten] connection accepted from 10.234.11.233:54629 #7 (5 connections now open) 2013-10-22T20:09:44.475+0000 [conn7] runQuery called local.oplog.rs {} 2013-10-22T20:09:44.475+0000 [conn7] query local.oplog.rs ntoreturn:1 ntoskip:0 keyUpdates:0 locks(micros) r:85 nreturned:1 reslen:106 0ms 2013-10-22T20:09:44.476+0000 [initandlisten] connection accepted from 10.234.11.233:54630 #8 (6 connections now open) 2013-10-22T20:09:44.476+0000 [conn8] runQuery called admin.$cmd { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c0007849804200a6a2cd'), member: 1, config: { _id: 1, host: "10.234.11.233:27018" } } } 2013-10-22T20:09:44.476+0000 [conn8] run command admin.$cmd { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c0007849804200a6a2cd'), member: 1, config: { _id: 1, host: "10.234.11.233:27018" } } } 2013-10-22T20:09:44.476+0000 [conn8] command: { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c0007849804200a6a2cd'), member: 1, config: { _id: 1, host: "10.234.11.233:27018" } } } 2013-10-22T20:09:44.476+0000 [conn8] command admin.$cmd command: { replSetUpdatePosition: 1, handshake: { handshake: ObjectId('5266c0007849804200a6a2cd'), member: 1, config: { _id: 1, host: "10.234.11.233:27018" } } } ntoreturn:1 keyUpdates:0 reslen:37 0ms 2013-10-22T20:09:44.476+0000 [conn7] runQuery called local.oplog.rs { ts: { $gte: Timestamp 1382472462000|1 } } 2013-10-22T20:09:44.476+0000 [conn7] query local.oplog.rs query: { ts: { $gte: Timestamp 1382472462000|1 } } cursorid:63248569264962 ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) r:72 nreturned:1 reslen:117 0ms 2013-10-22T20:09:44.975+0000 [conn8] runQuery called admin.$cmd { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c0007849804200a6a2cd'), optime: Timestamp 1382472462000|1, config: { _id: 1, host: "10.234.11.233:27018" } } ] } 2013-10-22T20:09:44.975+0000 [conn8] run command admin.$cmd { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c0007849804200a6a2cd'), optime: Timestamp 1382472462000|1, config: { _id: 1, host: "10.234.11.233:27018" } } ] } 2013-10-22T20:09:44.975+0000 [conn8] command: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c0007849804200a6a2cd'), optime: Timestamp 1382472462000|1, config: { _id: 1, host: "10.234.11.233:27018" } } ] } 2013-10-22T20:09:44.975+0000 [conn8] command admin.$cmd command: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('5266c0007849804200a6a2cd'), optime: Timestamp 1382472462000|1, config: { _id: 1, host: "10.234.11.233:27018" } } ] } ntoreturn:1 keyUpdates:0 reslen:37 0ms 2013-10-22T20:09:44.977+0000 [journal] _groupCommit 2013-10-22T20:09:44.977+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:44.977+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:44.977+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:44.977+0000 [journal] groupCommit end 2013-10-22T20:09:45.005+0000 [slaveTracking] processing update : query: { _id: ObjectId('5266c0007849804200a6a2cd'), config: { _id: 1, host: "10.234.11.233:27018" }, ns: "local.oplog.rs" } updated: { $set: { syncedTo: Timestamp 1382472462000|1 } } god: 0 upsert: 1 multi: 0 logToOplog: 1 fromMigration: 0 fromReplications: 0 2013-10-22T20:09:45.006+0000 [slaveTracking] running multiple plans 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher::matches() { : ObjectId('5266c0007849804200a6a2cd') } 1:c80c0b0 1 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher _docMatcher->matches() returns 1 2013-10-22T20:09:45.006+0000 [slaveTracking] update local.slaves query: { _id: ObjectId('5266c0007849804200a6a2cd'), config: { _id: 1, host: "10.234.11.233:27018" }, ns: "local.oplog.rs" } update: { $set: { syncedTo: Timestamp 1382472462000|1 } } nscanned:1 nupdated:1 keyUpdates:0 locks(micros) w:545 0ms 2013-10-22T20:09:45.006+0000 [slaveTracking] processing update : query: { _id: ObjectId('5266c00213a2cc9a81f3be1c'), config: { _id: 2, host: "10.234.11.233:27016" }, ns: "local.oplog.rs" } updated: { $set: { syncedTo: Timestamp 1382472462000|1 } } god: 0 upsert: 1 multi: 0 logToOplog: 1 fromMigration: 0 fromReplications: 0 2013-10-22T20:09:45.006+0000 [slaveTracking] running multiple plans 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher::matches() { : ObjectId('5266c00213a2cc9a81f3be1c') } 1:c80c140 1 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher _docMatcher->matches() returns 0 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher::matches() {} 1:c80c0b0 0 2013-10-22T20:09:45.006+0000 [slaveTracking] CoveredIndexMatcher _docMatcher->matches() returns 0 2013-10-22T20:09:45.007+0000 [slaveTracking] User Assertion: 11000:E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } 2013-10-22T20:09:45.007+0000 [slaveTracking] User Assertion: 11000:E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } 2013-10-22T20:09:45.007+0000 [slaveTracking] update local.slaves query: { _id: ObjectId('5266c00213a2cc9a81f3be1c'), config: { _id: 2, host: "10.234.11.233:27016" }, ns: "local.oplog.rs" } update: { $set: { syncedTo: Timestamp 1382472462000|1 } } nscanned:2 fastmodinsert:1 upsert:1 keyUpdates:0 exception: E11000 duplicate key error index: local.slaves.$_id_ dup key: { : ObjectId('5266c00213a2cc9a81f3be1c') } code:11000 locks(micros) w:665 0ms 2013-10-22T20:09:45.081+0000 [journal] journal WRITETODATAFILES 1 2013-10-22T20:09:45.081+0000 [journal] journal WRITETODATAFILES 2 2013-10-22T20:09:45.081+0000 [journal] journal WRITETODATAFILES 0.099ms 2013-10-22T20:09:45.378+0000 [initandlisten] connection accepted from 127.0.0.1:42066 #9 (7 connections now open) 2013-10-22T20:09:45.378+0000 [conn9] runQuery called admin.$cmd { whatsmyuri: 1 } 2013-10-22T20:09:45.378+0000 [conn9] run command admin.$cmd { whatsmyuri: 1 } 2013-10-22T20:09:45.378+0000 [conn9] command admin.$cmd command: { whatsmyuri: 1 } ntoreturn:1 keyUpdates:0 reslen:62 0ms 2013-10-22T20:09:45.381+0000 [conn9] runQuery called admin.$cmd { getLog: "startupWarnings" } 2013-10-22T20:09:45.381+0000 [conn9] run command admin.$cmd { getLog: "startupWarnings" } 2013-10-22T20:09:45.381+0000 [conn9] command: { getLog: "startupWarnings" } 2013-10-22T20:09:45.381+0000 [conn9] command admin.$cmd command: { getLog: "startupWarnings" } ntoreturn:1 keyUpdates:0 reslen:380 0ms 2013-10-22T20:09:45.383+0000 [conn9] runQuery called admin.$cmd { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:45.383+0000 [conn9] run command admin.$cmd { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:45.383+0000 [conn9] command: { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:45.383+0000 [conn9] command admin.$cmd command: { replSetGetStatus: 1.0, forShell: 1.0 } ntoreturn:1 keyUpdates:0 reslen:752 0ms 2013-10-22T20:09:45.473+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:45.473+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:45.473+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:45.473+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:45.688+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:46.001+0000 [journal] _groupCommit 2013-10-22T20:09:46.001+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:46.001+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:46.001+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:46.001+0000 [journal] groupCommit end 2013-10-22T20:09:46.040+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:46.040+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:46.040+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:46.040+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:47.014+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:184 nreturned:0 reslen:20 5011ms 2013-10-22T20:09:47.024+0000 [journal] _groupCommit 2013-10-22T20:09:47.024+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:47.024+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:47.024+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:47.024+0000 [journal] groupCommit end 2013-10-22T20:09:47.473+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:47.473+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:47.473+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:47.473+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:47.839+0000 [conn9] runQuery called admin.$cmd { replSetGetStatus: 1.0 } 2013-10-22T20:09:47.839+0000 [conn9] run command admin.$cmd { replSetGetStatus: 1.0 } 2013-10-22T20:09:47.839+0000 [conn9] command: { replSetGetStatus: 1.0 } 2013-10-22T20:09:47.839+0000 [conn9] command admin.$cmd command: { replSetGetStatus: 1.0 } ntoreturn:1 keyUpdates:0 reslen:845 0ms 2013-10-22T20:09:47.844+0000 [conn9] runQuery called admin.$cmd { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:47.844+0000 [conn9] run command admin.$cmd { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:47.844+0000 [conn9] command: { replSetGetStatus: 1.0, forShell: 1.0 } 2013-10-22T20:09:47.844+0000 [conn9] command admin.$cmd command: { replSetGetStatus: 1.0, forShell: 1.0 } ntoreturn:1 keyUpdates:0 reslen:845 0ms 2013-10-22T20:09:48.040+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:48.041+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:48.041+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:48.041+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:48.046+0000 [journal] _groupCommit 2013-10-22T20:09:48.046+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:48.046+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:48.046+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:48.046+0000 [journal] groupCommit end 2013-10-22T20:09:49.068+0000 [journal] _groupCommit 2013-10-22T20:09:49.069+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:49.069+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:49.069+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:49.069+0000 [journal] groupCommit end 2013-10-22T20:09:49.474+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:49.486+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:49.486+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:49.486+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:49.490+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:157 nreturned:0 reslen:20 5010ms 2013-10-22T20:09:50.041+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:50.041+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:50.041+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:50.041+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:50.091+0000 [journal] _groupCommit 2013-10-22T20:09:50.091+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:50.091+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:50.091+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:50.091+0000 [journal] groupCommit end 2013-10-22T20:09:50.960+0000 [conn9] Socket recv() conn closed? 127.0.0.1:42066 2013-10-22T20:09:50.960+0000 [conn9] SocketException: remote: 127.0.0.1:42066 error: 9001 socket exception [CLOSED] server [127.0.0.1:42066] 2013-10-22T20:09:50.960+0000 [conn9] end connection 127.0.0.1:42066 (6 connections now open) 2013-10-22T20:09:51.113+0000 [journal] _groupCommit 2013-10-22T20:09:51.113+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:51.113+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:51.113+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:51.113+0000 [journal] groupCommit end 2013-10-22T20:09:51.487+0000 [conn4] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:51.487+0000 [conn4] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:51.487+0000 [conn4] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:51.487+0000 [conn4] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:52.027+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:127 nreturned:0 reslen:20 5010ms 2013-10-22T20:09:52.041+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:52.041+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:52.042+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:52.042+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:52.135+0000 [journal] _groupCommit 2013-10-22T20:09:52.135+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:52.135+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:52.136+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:52.136+0000 [journal] groupCommit end 2013-10-22T20:09:53.158+0000 [journal] _groupCommit 2013-10-22T20:09:53.158+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:53.158+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:53.158+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:53.158+0000 [journal] groupCommit end 2013-10-22T20:09:53.487+0000 [conn4] Socket recv() conn closed? 10.234.11.233:54621 2013-10-22T20:09:53.487+0000 [conn4] SocketException: remote: 10.234.11.233:54621 error: 9001 socket exception [CLOSED] server [10.234.11.233:54621] 2013-10-22T20:09:53.487+0000 [conn4] end connection 10.234.11.233:54621 (5 connections now open) 2013-10-22T20:09:53.487+0000 [initandlisten] connection accepted from 10.234.11.233:54634 #10 (6 connections now open) 2013-10-22T20:09:53.488+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:53.488+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:53.488+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:53.488+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:54.042+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:54.042+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:54.042+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:54.042+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:54.180+0000 [journal] _groupCommit 2013-10-22T20:09:54.180+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:54.180+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:54.180+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:54.180+0000 [journal] groupCommit end 2013-10-22T20:09:54.503+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:111 nreturned:0 reslen:20 5010ms 2013-10-22T20:09:55.203+0000 [journal] _groupCommit 2013-10-22T20:09:55.203+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:55.203+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:55.203+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:55.203+0000 [journal] groupCommit end 2013-10-22T20:09:55.488+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:55.488+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:55.488+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:55.488+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:56.042+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:56.042+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:56.042+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:56.042+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:56.225+0000 [journal] _groupCommit 2013-10-22T20:09:56.225+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:56.225+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:56.225+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:56.225+0000 [journal] groupCommit end 2013-10-22T20:09:57.041+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:113 nreturned:0 reslen:20 5010ms 2013-10-22T20:09:57.247+0000 [journal] _groupCommit 2013-10-22T20:09:57.247+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:57.247+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:57.247+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:57.247+0000 [journal] groupCommit end 2013-10-22T20:09:57.489+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:57.489+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:57.489+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:57.489+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:57.658+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:09:58.043+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:58.043+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:58.043+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:09:58.043+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:58.270+0000 [journal] _groupCommit 2013-10-22T20:09:58.270+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:58.270+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:58.270+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:09:58.270+0000 [journal] groupCommit end 2013-10-22T20:09:59.292+0000 [journal] _groupCommit 2013-10-22T20:09:59.292+0000 [journal] _groupCommit upgrade 2013-10-22T20:09:59.292+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:09:59.292+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:09:59.292+0000 [journal] groupCommit end 2013-10-22T20:09:59.489+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:59.489+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:59.489+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:09:59.489+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:09:59.516+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:125 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:00.043+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:00.043+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:00.043+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:00.043+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:00.314+0000 [journal] _groupCommit 2013-10-22T20:10:00.314+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:00.315+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:00.315+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:00.315+0000 [journal] groupCommit end 2013-10-22T20:10:01.337+0000 [journal] _groupCommit 2013-10-22T20:10:01.337+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:01.337+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:01.337+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:01.337+0000 [journal] groupCommit end 2013-10-22T20:10:01.490+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:01.490+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:01.490+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:01.490+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:02.044+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:02.044+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:02.044+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:02.044+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:02.054+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:136 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:02.360+0000 [journal] _groupCommit 2013-10-22T20:10:02.360+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:02.360+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:02.360+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:02.360+0000 [journal] groupCommit end 2013-10-22T20:10:03.382+0000 [journal] _groupCommit 2013-10-22T20:10:03.382+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:03.382+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:03.382+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:03.382+0000 [journal] groupCommit end 2013-10-22T20:10:03.490+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:03.490+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:03.490+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:03.490+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:04.044+0000 [conn3] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:04.044+0000 [conn3] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:04.044+0000 [conn3] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:04.045+0000 [conn3] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:04.404+0000 [journal] _groupCommit 2013-10-22T20:10:04.404+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:04.404+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:04.404+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:04.405+0000 [journal] groupCommit end 2013-10-22T20:10:04.529+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:144 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:05.427+0000 [journal] _groupCommit 2013-10-22T20:10:05.427+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:05.427+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:05.427+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:05.427+0000 [journal] groupCommit end 2013-10-22T20:10:05.491+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:05.491+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:05.491+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:05.491+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:06.045+0000 [conn3] Socket recv() conn closed? 10.234.11.233:54598 2013-10-22T20:10:06.045+0000 [conn3] SocketException: remote: 10.234.11.233:54598 error: 9001 socket exception [CLOSED] server [10.234.11.233:54598] 2013-10-22T20:10:06.045+0000 [conn3] end connection 10.234.11.233:54598 (5 connections now open) 2013-10-22T20:10:06.045+0000 [initandlisten] connection accepted from 10.234.11.233:54636 #11 (6 connections now open) 2013-10-22T20:10:06.045+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:06.045+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:06.046+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:06.046+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:06.449+0000 [journal] _groupCommit 2013-10-22T20:10:06.449+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:06.449+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:06.449+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:06.449+0000 [journal] groupCommit end 2013-10-22T20:10:07.067+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:118 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:07.471+0000 [journal] _groupCommit 2013-10-22T20:10:07.472+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:07.472+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:07.472+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:07.472+0000 [journal] groupCommit end 2013-10-22T20:10:07.491+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:07.491+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:07.491+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:07.491+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:08.046+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:08.046+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:08.046+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:08.046+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:08.494+0000 [journal] _groupCommit 2013-10-22T20:10:08.494+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:08.494+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:08.494+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:08.494+0000 [journal] groupCommit end 2013-10-22T20:10:09.492+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:09.492+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:09.492+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:09.492+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:09.516+0000 [journal] _groupCommit 2013-10-22T20:10:09.517+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:09.517+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:09.517+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:09.517+0000 [journal] groupCommit end 2013-10-22T20:10:09.543+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:151 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:10.046+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:10.047+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:10.047+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:10.047+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:10.539+0000 [journal] _groupCommit 2013-10-22T20:10:10.539+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:10.539+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:10.539+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:10.539+0000 [journal] groupCommit end 2013-10-22T20:10:11.492+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:11.492+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:11.492+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:11.492+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:11.562+0000 [journal] _groupCommit 2013-10-22T20:10:11.562+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:11.562+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:11.562+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:11.562+0000 [journal] groupCommit end 2013-10-22T20:10:12.047+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:12.047+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:12.047+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:12.047+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:12.081+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:162 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:12.584+0000 [journal] _groupCommit 2013-10-22T20:10:12.584+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:12.584+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:12.584+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:12.584+0000 [journal] groupCommit end 2013-10-22T20:10:13.493+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:13.493+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:13.493+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:13.493+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:13.607+0000 [journal] _groupCommit 2013-10-22T20:10:13.607+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:13.607+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:13.607+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:13.607+0000 [journal] groupCommit end 2013-10-22T20:10:14.048+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:14.048+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:14.048+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:14.048+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:14.556+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:144 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:14.629+0000 [journal] _groupCommit 2013-10-22T20:10:14.629+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:14.629+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:14.629+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:14.629+0000 [journal] groupCommit end 2013-10-22T20:10:15.493+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:15.493+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:15.493+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:15.493+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:15.652+0000 [journal] _groupCommit 2013-10-22T20:10:15.652+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:15.652+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:15.652+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:15.652+0000 [journal] groupCommit end 2013-10-22T20:10:15.695+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:10:16.048+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:16.048+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:16.048+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:16.048+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:16.674+0000 [journal] _groupCommit 2013-10-22T20:10:16.674+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:16.674+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:16.674+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:16.674+0000 [journal] groupCommit end 2013-10-22T20:10:17.094+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:119 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:17.494+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:17.494+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:17.494+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:17.494+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:17.697+0000 [journal] _groupCommit 2013-10-22T20:10:17.697+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:17.697+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:17.697+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:17.697+0000 [journal] groupCommit end 2013-10-22T20:10:18.049+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:18.049+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:18.049+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:18.049+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:18.719+0000 [journal] _groupCommit 2013-10-22T20:10:18.719+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:18.719+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:18.719+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:18.719+0000 [journal] groupCommit end 2013-10-22T20:10:19.494+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:19.494+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:19.494+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:19.494+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:19.569+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:142 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:19.742+0000 [journal] _groupCommit 2013-10-22T20:10:19.742+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:19.742+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:19.742+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:19.742+0000 [journal] groupCommit end 2013-10-22T20:10:20.049+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:20.049+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:20.049+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:20.049+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:20.764+0000 [journal] _groupCommit 2013-10-22T20:10:20.764+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:20.764+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:20.764+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:20.764+0000 [journal] groupCommit end 2013-10-22T20:10:21.495+0000 [conn10] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:21.495+0000 [conn10] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:21.495+0000 [conn10] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:21.495+0000 [conn10] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:21.786+0000 [journal] _groupCommit 2013-10-22T20:10:21.786+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:21.786+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:21.786+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:21.786+0000 [journal] groupCommit end 2013-10-22T20:10:22.050+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:22.050+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:22.050+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:22.050+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:22.107+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:152 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:22.809+0000 [journal] _groupCommit 2013-10-22T20:10:22.809+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:22.809+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:22.809+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:22.809+0000 [journal] groupCommit end 2013-10-22T20:10:23.495+0000 [conn10] Socket recv() conn closed? 10.234.11.233:54634 2013-10-22T20:10:23.495+0000 [conn10] SocketException: remote: 10.234.11.233:54634 error: 9001 socket exception [CLOSED] server [10.234.11.233:54634] 2013-10-22T20:10:23.495+0000 [conn10] end connection 10.234.11.233:54634 (5 connections now open) 2013-10-22T20:10:23.495+0000 [initandlisten] connection accepted from 10.234.11.233:54642 #12 (6 connections now open) 2013-10-22T20:10:23.496+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:23.496+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:23.496+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:23.496+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:23.831+0000 [journal] _groupCommit 2013-10-22T20:10:23.831+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:23.831+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:23.831+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:23.831+0000 [journal] groupCommit end 2013-10-22T20:10:24.050+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:24.050+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:24.050+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:24.050+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:24.582+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:114 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:24.853+0000 [journal] _groupCommit 2013-10-22T20:10:24.853+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:24.853+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:24.853+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:24.853+0000 [journal] groupCommit end 2013-10-22T20:10:25.496+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:25.496+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:25.496+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:25.496+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:25.875+0000 [journal] _groupCommit 2013-10-22T20:10:25.875+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:25.875+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:25.875+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:25.875+0000 [journal] groupCommit end 2013-10-22T20:10:26.051+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:26.051+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:26.051+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:26.051+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:26.898+0000 [journal] _groupCommit 2013-10-22T20:10:26.898+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:26.898+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:26.898+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:26.898+0000 [journal] groupCommit end 2013-10-22T20:10:27.120+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:138 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:27.497+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:27.497+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:27.497+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:27.497+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:27.666+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:10:27.920+0000 [journal] _groupCommit 2013-10-22T20:10:27.920+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:27.920+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:27.920+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:27.920+0000 [journal] groupCommit end 2013-10-22T20:10:28.051+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:28.051+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:28.051+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:28.051+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:28.943+0000 [journal] _groupCommit 2013-10-22T20:10:28.943+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:28.943+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:28.943+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:28.943+0000 [journal] groupCommit end 2013-10-22T20:10:29.497+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:29.497+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:29.497+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:29.497+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:29.596+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:127 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:29.607+0000 [DataFileSync] flushing mmaps took 0ms for 4 files 2013-10-22T20:10:29.645+0000 [PeriodicTask::Runner] task: DBConnectionPool-cleaner took: 0ms 2013-10-22T20:10:29.645+0000 [PeriodicTask::Runner] task: WriteBackManager::cleaner took: 0ms 2013-10-22T20:10:29.645+0000 [PeriodicTask::Runner] task: DBConnectionPool-cleaner took: 0ms 2013-10-22T20:10:29.645+0000 [TTLMonitor] TTLMonitor thread awake 2013-10-22T20:10:29.645+0000 [TTLMonitor] runQuery called admin.system.indexes { expireAfterSeconds: { $exists: true } } 2013-10-22T20:10:29.645+0000 [TTLMonitor] query admin.system.indexes query: { expireAfterSeconds: { $exists: true } } ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) r:51 nreturned:0 reslen:20 0ms 2013-10-22T20:10:29.645+0000 [TTLMonitor] runQuery called local.system.indexes { expireAfterSeconds: { $exists: true } } 2013-10-22T20:10:29.646+0000 [TTLMonitor] query local.system.indexes query: { expireAfterSeconds: { $exists: true } } ntoreturn:0 ntoskip:0 keyUpdates:0 locks(micros) r:108 nreturned:0 reslen:20 0ms 2013-10-22T20:10:29.647+0000 [clientcursormon] mem (MB) res:37 virt:1286 2013-10-22T20:10:29.647+0000 [clientcursormon] mapped (incl journal view):576 2013-10-22T20:10:29.647+0000 [clientcursormon] connections:6 2013-10-22T20:10:29.647+0000 [clientcursormon] replication threads:32 2013-10-22T20:10:29.965+0000 [journal] _groupCommit 2013-10-22T20:10:29.965+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:29.965+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:29.965+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:29.965+0000 [journal] groupCommit end 2013-10-22T20:10:30.052+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:30.052+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:30.052+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:30.052+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:30.987+0000 [journal] _groupCommit 2013-10-22T20:10:30.988+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:30.988+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:30.988+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:30.988+0000 [journal] groupCommit end 2013-10-22T20:10:31.498+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:31.498+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:31.498+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:31.498+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:32.010+0000 [journal] _groupCommit 2013-10-22T20:10:32.010+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:32.010+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:32.010+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:32.010+0000 [journal] groupCommit end 2013-10-22T20:10:32.052+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:32.052+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:32.052+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:32.052+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:32.134+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:130 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:33.032+0000 [journal] _groupCommit 2013-10-22T20:10:33.032+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:33.032+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:33.032+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:33.032+0000 [journal] groupCommit end 2013-10-22T20:10:33.498+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:33.498+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:33.498+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:33.498+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:34.052+0000 [conn11] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:34.053+0000 [conn11] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:34.053+0000 [conn11] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:34.053+0000 [conn11] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:34.055+0000 [journal] _groupCommit 2013-10-22T20:10:34.055+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:34.055+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:34.055+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:34.055+0000 [journal] groupCommit end 2013-10-22T20:10:34.609+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:155 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:35.077+0000 [journal] _groupCommit 2013-10-22T20:10:35.077+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:35.077+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:35.077+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:35.077+0000 [journal] groupCommit end 2013-10-22T20:10:35.499+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:35.499+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:35.499+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:35.499+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:36.053+0000 [conn11] Socket recv() conn closed? 10.234.11.233:54636 2013-10-22T20:10:36.053+0000 [conn11] SocketException: remote: 10.234.11.233:54636 error: 9001 socket exception [CLOSED] server [10.234.11.233:54636] 2013-10-22T20:10:36.053+0000 [conn11] end connection 10.234.11.233:54636 (5 connections now open) 2013-10-22T20:10:36.053+0000 [initandlisten] connection accepted from 10.234.11.233:54644 #13 (6 connections now open) 2013-10-22T20:10:36.053+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:36.054+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:36.054+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:36.054+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:36.099+0000 [journal] _groupCommit 2013-10-22T20:10:36.099+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:36.099+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:36.099+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:36.099+0000 [journal] groupCommit end 2013-10-22T20:10:37.121+0000 [journal] _groupCommit 2013-10-22T20:10:37.122+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:37.122+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:37.122+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:37.122+0000 [journal] groupCommit end 2013-10-22T20:10:37.147+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:114 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:37.499+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:37.499+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:37.499+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:37.499+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:38.054+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:38.054+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:38.054+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:38.054+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:38.144+0000 [journal] _groupCommit 2013-10-22T20:10:38.144+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:38.144+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:38.144+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:38.144+0000 [journal] groupCommit end 2013-10-22T20:10:39.166+0000 [journal] _groupCommit 2013-10-22T20:10:39.166+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:39.166+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:39.166+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:39.166+0000 [journal] groupCommit end 2013-10-22T20:10:39.499+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:39.499+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:39.500+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:39.500+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:39.622+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:121 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:40.054+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:40.054+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:40.054+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:40.055+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:40.189+0000 [journal] _groupCommit 2013-10-22T20:10:40.189+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:40.189+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:40.189+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:40.189+0000 [journal] groupCommit end 2013-10-22T20:10:41.211+0000 [journal] _groupCommit 2013-10-22T20:10:41.211+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:41.211+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:41.211+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:41.211+0000 [journal] groupCommit end 2013-10-22T20:10:41.500+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:41.500+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:41.500+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:41.500+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:42.055+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:42.055+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:42.055+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:42.055+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:42.160+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:107 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:42.233+0000 [journal] _groupCommit 2013-10-22T20:10:42.233+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:42.234+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:42.234+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:42.234+0000 [journal] groupCommit end 2013-10-22T20:10:43.256+0000 [journal] _groupCommit 2013-10-22T20:10:43.256+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:43.256+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:43.256+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:43.256+0000 [journal] groupCommit end 2013-10-22T20:10:43.500+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:43.500+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:43.501+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:43.501+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:44.055+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:44.055+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:44.055+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:44.055+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:44.278+0000 [journal] _groupCommit 2013-10-22T20:10:44.279+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:44.279+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:44.279+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:44.279+0000 [journal] groupCommit end 2013-10-22T20:10:44.636+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:114 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:45.301+0000 [journal] _groupCommit 2013-10-22T20:10:45.301+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:45.301+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:45.301+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:45.301+0000 [journal] groupCommit end 2013-10-22T20:10:45.501+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:45.501+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:45.501+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:45.501+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:45.703+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:10:46.056+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:46.056+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:46.056+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:46.056+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:46.323+0000 [journal] _groupCommit 2013-10-22T20:10:46.323+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:46.323+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:46.323+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:46.323+0000 [journal] groupCommit end 2013-10-22T20:10:47.173+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:108 nreturned:0 reslen:20 5010ms 2013-10-22T20:10:47.346+0000 [journal] _groupCommit 2013-10-22T20:10:47.346+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:47.346+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:47.346+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:47.346+0000 [journal] groupCommit end 2013-10-22T20:10:47.501+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:47.502+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:47.502+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:47.502+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:48.056+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:48.056+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:48.056+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:48.057+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:48.369+0000 [journal] _groupCommit 2013-10-22T20:10:48.369+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:48.369+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:48.369+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:48.369+0000 [journal] groupCommit end 2013-10-22T20:10:49.391+0000 [journal] _groupCommit 2013-10-22T20:10:49.391+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:49.391+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:49.391+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:49.391+0000 [journal] groupCommit end 2013-10-22T20:10:49.502+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:49.502+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:49.503+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:49.503+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:49.649+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:143 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:50.057+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:50.057+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:50.057+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:50.057+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:50.414+0000 [journal] _groupCommit 2013-10-22T20:10:50.414+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:50.414+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:50.414+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:50.414+0000 [journal] groupCommit end 2013-10-22T20:10:51.436+0000 [journal] _groupCommit 2013-10-22T20:10:51.436+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:51.436+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:51.436+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:51.436+0000 [journal] groupCommit end 2013-10-22T20:10:51.503+0000 [conn12] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:51.503+0000 [conn12] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:51.503+0000 [conn12] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:51.503+0000 [conn12] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:52.057+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:52.057+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:52.058+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:52.058+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:52.187+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:181 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:52.459+0000 [journal] _groupCommit 2013-10-22T20:10:52.459+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:52.459+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:52.459+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:52.459+0000 [journal] groupCommit end 2013-10-22T20:10:53.481+0000 [journal] _groupCommit 2013-10-22T20:10:53.481+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:53.481+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:53.481+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:53.481+0000 [journal] groupCommit end 2013-10-22T20:10:53.504+0000 [conn12] Socket recv() conn closed? 10.234.11.233:54642 2013-10-22T20:10:53.504+0000 [conn12] SocketException: remote: 10.234.11.233:54642 error: 9001 socket exception [CLOSED] server [10.234.11.233:54642] 2013-10-22T20:10:53.504+0000 [conn12] end connection 10.234.11.233:54642 (5 connections now open) 2013-10-22T20:10:53.504+0000 [initandlisten] connection accepted from 10.234.11.233:54649 #14 (6 connections now open) 2013-10-22T20:10:53.504+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:53.504+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:53.504+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:53.504+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:54.058+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:54.058+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:54.058+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:54.058+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:54.504+0000 [journal] _groupCommit 2013-10-22T20:10:54.504+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:54.504+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:54.504+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:54.504+0000 [journal] groupCommit end 2013-10-22T20:10:54.662+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:190 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:55.505+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:55.505+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:55.505+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:55.505+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:55.527+0000 [journal] _groupCommit 2013-10-22T20:10:55.527+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:55.527+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:55.527+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:55.527+0000 [journal] groupCommit end 2013-10-22T20:10:56.059+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:56.059+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:56.062+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:56.062+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:56.549+0000 [journal] _groupCommit 2013-10-22T20:10:56.549+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:56.550+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:56.550+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:56.550+0000 [journal] groupCommit end 2013-10-22T20:10:57.200+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:186 nreturned:0 reslen:20 5011ms 2013-10-22T20:10:57.505+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:57.505+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:57.505+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:57.505+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:57.572+0000 [journal] _groupCommit 2013-10-22T20:10:57.572+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:57.572+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:57.572+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:57.572+0000 [journal] groupCommit end 2013-10-22T20:10:57.674+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:10:58.062+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:58.062+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:58.062+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:10:58.062+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:58.594+0000 [journal] _groupCommit 2013-10-22T20:10:58.594+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:58.594+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:58.594+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:10:58.594+0000 [journal] groupCommit end 2013-10-22T20:10:59.506+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:59.506+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:59.506+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:10:59.506+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:10:59.617+0000 [journal] _groupCommit 2013-10-22T20:10:59.617+0000 [journal] _groupCommit upgrade 2013-10-22T20:10:59.617+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:10:59.617+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:10:59.617+0000 [journal] groupCommit end 2013-10-22T20:10:59.676+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:175 nreturned:0 reslen:20 5011ms 2013-10-22T20:11:00.063+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:00.063+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:00.063+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:00.063+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:00.639+0000 [journal] _groupCommit 2013-10-22T20:11:00.639+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:00.639+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:00.639+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:00.639+0000 [journal] groupCommit end 2013-10-22T20:11:01.506+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:01.506+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:01.506+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:01.506+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:01.661+0000 [journal] _groupCommit 2013-10-22T20:11:01.662+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:01.662+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:01.662+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:01.662+0000 [journal] groupCommit end 2013-10-22T20:11:02.063+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:02.063+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:02.063+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:02.063+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:02.213+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:195 nreturned:0 reslen:20 5011ms 2013-10-22T20:11:02.684+0000 [journal] _groupCommit 2013-10-22T20:11:02.684+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:02.684+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:02.684+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:02.684+0000 [journal] groupCommit end 2013-10-22T20:11:03.507+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:03.507+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:03.507+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:03.507+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:03.706+0000 [journal] _groupCommit 2013-10-22T20:11:03.706+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:03.707+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:03.707+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:03.707+0000 [journal] groupCommit end 2013-10-22T20:11:04.064+0000 [conn13] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:04.064+0000 [conn13] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:04.064+0000 [conn13] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:04.064+0000 [conn13] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:04.689+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:142 nreturned:0 reslen:20 5011ms 2013-10-22T20:11:04.729+0000 [journal] _groupCommit 2013-10-22T20:11:04.729+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:04.729+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:04.729+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:04.729+0000 [journal] groupCommit end 2013-10-22T20:11:05.507+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:05.507+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:05.507+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:05.507+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:05.751+0000 [journal] _groupCommit 2013-10-22T20:11:05.751+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:05.751+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:05.751+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:05.751+0000 [journal] groupCommit end 2013-10-22T20:11:06.064+0000 [conn13] Socket recv() conn closed? 10.234.11.233:54644 2013-10-22T20:11:06.064+0000 [conn13] SocketException: remote: 10.234.11.233:54644 error: 9001 socket exception [CLOSED] server [10.234.11.233:54644] 2013-10-22T20:11:06.064+0000 [conn13] end connection 10.234.11.233:54644 (5 connections now open) 2013-10-22T20:11:06.065+0000 [initandlisten] connection accepted from 10.234.11.233:54651 #15 (6 connections now open) 2013-10-22T20:11:06.065+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:06.065+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:06.065+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:06.065+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:06.773+0000 [journal] _groupCommit 2013-10-22T20:11:06.773+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:06.774+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:06.774+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:06.774+0000 [journal] groupCommit end 2013-10-22T20:11:07.227+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:139 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:07.508+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:07.508+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:07.508+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:07.508+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:07.796+0000 [journal] _groupCommit 2013-10-22T20:11:07.796+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:07.796+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:07.796+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:07.796+0000 [journal] groupCommit end 2013-10-22T20:11:08.065+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:08.066+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:08.066+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:08.066+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:08.818+0000 [journal] _groupCommit 2013-10-22T20:11:08.818+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:08.818+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:08.818+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:08.819+0000 [journal] groupCommit end 2013-10-22T20:11:09.508+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:09.508+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:09.508+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:09.508+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:09.702+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:133 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:09.841+0000 [journal] _groupCommit 2013-10-22T20:11:09.841+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:09.841+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:09.841+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:09.841+0000 [journal] groupCommit end 2013-10-22T20:11:10.066+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:10.066+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:10.066+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:10.066+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:10.863+0000 [journal] _groupCommit 2013-10-22T20:11:10.863+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:10.863+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:10.863+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:10.863+0000 [journal] groupCommit end 2013-10-22T20:11:11.509+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:11.509+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:11.509+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:11.509+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:11.886+0000 [journal] _groupCommit 2013-10-22T20:11:11.886+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:11.886+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:11.886+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:11.886+0000 [journal] groupCommit end 2013-10-22T20:11:12.067+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:12.067+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:12.067+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:12.067+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:12.240+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:161 nreturned:0 reslen:20 5011ms 2013-10-22T20:11:12.908+0000 [journal] _groupCommit 2013-10-22T20:11:12.908+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:12.908+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:12.908+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:12.908+0000 [journal] groupCommit end 2013-10-22T20:11:13.509+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:13.509+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:13.509+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:13.509+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:13.931+0000 [journal] _groupCommit 2013-10-22T20:11:13.931+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:13.931+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:13.931+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:13.931+0000 [journal] groupCommit end 2013-10-22T20:11:14.067+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:14.067+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:14.067+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:14.067+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:14.716+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:138 nreturned:0 reslen:20 5011ms 2013-10-22T20:11:14.953+0000 [journal] _groupCommit 2013-10-22T20:11:14.953+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:14.953+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:14.953+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:14.953+0000 [journal] groupCommit end 2013-10-22T20:11:15.510+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:15.510+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:15.510+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:15.510+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:15.711+0000 BackgroundJob starting: ConnectBG 2013-10-22T20:11:15.975+0000 [journal] _groupCommit 2013-10-22T20:11:15.976+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:15.976+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:15.976+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:15.976+0000 [journal] groupCommit end 2013-10-22T20:11:16.068+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:16.068+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:16.068+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:16.068+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:16.998+0000 [journal] _groupCommit 2013-10-22T20:11:16.998+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:16.998+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:16.998+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:16.998+0000 [journal] groupCommit end 2013-10-22T20:11:17.253+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:120 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:17.510+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:17.510+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:17.510+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:17.510+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:18.020+0000 [journal] _groupCommit 2013-10-22T20:11:18.021+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:18.021+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:18.021+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:18.021+0000 [journal] groupCommit end 2013-10-22T20:11:18.068+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:18.068+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:18.068+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:18.068+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:19.043+0000 [journal] _groupCommit 2013-10-22T20:11:19.043+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:19.043+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:19.043+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:19.043+0000 [journal] groupCommit end 2013-10-22T20:11:19.510+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:19.511+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:19.511+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:19.511+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:19.729+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:107 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:20.065+0000 [journal] _groupCommit 2013-10-22T20:11:20.065+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:20.065+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:20.066+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:20.066+0000 [journal] groupCommit end 2013-10-22T20:11:20.069+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:20.069+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:20.069+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:20.069+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:21.088+0000 [journal] _groupCommit 2013-10-22T20:11:21.088+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:21.088+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:21.088+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:21.088+0000 [journal] groupCommit end 2013-10-22T20:11:21.511+0000 [conn14] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:21.511+0000 [conn14] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:21.511+0000 [conn14] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:21.511+0000 [conn14] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:22.069+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:22.069+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:22.069+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:22.069+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:22.110+0000 [journal] _groupCommit 2013-10-22T20:11:22.110+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:22.110+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:22.110+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:22.110+0000 [journal] groupCommit end 2013-10-22T20:11:22.266+0000 [conn5] getmore local.oplog.rs cursorid:52684169410786 ntoreturn:0 keyUpdates:0 locks(micros) r:106 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:23.133+0000 [journal] _groupCommit 2013-10-22T20:11:23.133+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:23.133+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:23.133+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:23.133+0000 [journal] groupCommit end 2013-10-22T20:11:23.511+0000 [conn14] Socket recv() conn closed? 10.234.11.233:54649 2013-10-22T20:11:23.511+0000 [conn14] SocketException: remote: 10.234.11.233:54649 error: 9001 socket exception [CLOSED] server [10.234.11.233:54649] 2013-10-22T20:11:23.511+0000 [conn14] end connection 10.234.11.233:54649 (5 connections now open) 2013-10-22T20:11:23.512+0000 [initandlisten] connection accepted from 10.234.11.233:54655 #16 (6 connections now open) 2013-10-22T20:11:23.512+0000 [conn16] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:23.512+0000 [conn16] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:23.512+0000 [conn16] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:23.512+0000 [conn16] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:24.069+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:24.069+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:24.069+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:24.070+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:24.155+0000 [journal] _groupCommit 2013-10-22T20:11:24.155+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:24.155+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:24.155+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:24.155+0000 [journal] groupCommit end 2013-10-22T20:11:24.742+0000 [conn7] getmore local.oplog.rs cursorid:63248569264962 ntoreturn:0 keyUpdates:0 locks(micros) r:115 nreturned:0 reslen:20 5010ms 2013-10-22T20:11:25.178+0000 [journal] _groupCommit 2013-10-22T20:11:25.178+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:25.178+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:25.178+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 0 n:2 0ms 2013-10-22T20:11:25.178+0000 [journal] groupCommit end 2013-10-22T20:11:25.512+0000 [conn16] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:25.512+0000 [conn16] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:25.513+0000 [conn16] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } 2013-10-22T20:11:25.513+0000 [conn16] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27018" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:26.070+0000 [conn15] runQuery called admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:26.070+0000 [conn15] run command admin.$cmd { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:26.070+0000 [conn15] command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } 2013-10-22T20:11:26.070+0000 [conn15] command admin.$cmd command: { replSetHeartbeat: "set1", v: 9, pv: 1, checkEmpty: false, from: "10.234.11.233:27016" } ntoreturn:1 keyUpdates:0 reslen:120 0ms 2013-10-22T20:11:26.200+0000 [journal] _groupCommit 2013-10-22T20:11:26.200+0000 [journal] _groupCommit upgrade 2013-10-22T20:11:26.200+0000 [journal] journal REMAPPRIVATEVIEW 2013-10-22T20:11:26.200+0000 [journal] journal REMAPPRIVATEVIEW done startedAt: 2 n:2 0ms 2013-10-22T20:11:26.200+0000 [journal] groupCommit end