Mon May 9 18:58:16 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:17 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:18 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:20 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:20 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:20 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb04.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb04.example.com:27018", "mongodb05.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:20 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:21 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 18:58:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 18:58:32 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 18:58:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb04.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb04.example.com:27018", "mongodb05.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:58:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 18:58:56 [WriteBackListener] SocketException: remote: error: 9001 socket exception [0] Mon May 9 18:58:56 [WriteBackListener] DBClientCursor::init call() failed Mon May 9 18:58:56 [WriteBackListener] WriteBackListener exception : DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { writebacklisten: ObjectId('4dc46ef31dc02d61ad0bcce3') } Mon May 9 18:58:56 [conn18] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:58:56 [conn18] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:58:56 [conn18] AssertionException in process: dbclient error communicating with server: mongodb04.example.com:27018 Mon May 9 18:58:56 BackgroundJob starting: ConnectBG Mon May 9 18:58:56 [conn21] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:58:56 [conn21] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:58:56 [conn21] AssertionException in process: dbclient error communicating with server: mongodb04.example.com:27018 Mon May 9 18:58:56 BackgroundJob starting: ConnectBG Mon May 9 18:58:56 [conn22] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:58:56 [conn22] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:58:56 [conn22] DBClientCursor::init call() failed Mon May 9 18:58:56 [conn22] Assertion: 13633:error querying server: 2/mongodb05.example.com:27018,mongodb04.example.com:27018 Mon May 9 18:58:56 [conn22] AssertionException in process: error querying server: 2/mongodb05.example.com:27018,mongodb04.example.com:27018 Mon May 9 18:58:57 [WriteBackListener] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:58:57 [WriteBackListener] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:58:57 [WriteBackListener] DBClientCursor::init call() failed Mon May 9 18:58:57 [WriteBackListener] WriteBackListener exception : DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { writebacklisten: ObjectId('4dc46ef31dc02d61ad0bcce3') } Mon May 9 18:58:57 BackgroundJob starting: ConnectBG Mon May 9 18:58:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:57 [conn22] setShardVersion failed! Mon May 9 18:58:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:58:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:57 [conn3] setShardVersion success! Mon May 9 18:58:57 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 18:58:57 [conn22] setShardVersion failed! Mon May 9 18:58:57 [conn22] going to retry checkShardVersion Mon May 9 18:58:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbf94001e90 Mon May 9 18:58:57 [conn3] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:58:57 [conn3] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:58:57 [conn3] DBClientCursor::init call() failed Mon May 9 18:58:57 [conn3] AssertionException in process: DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } Mon May 9 18:58:57 BackgroundJob starting: ConnectBG Mon May 9 18:58:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:57 [conn3] setShardVersion failed! Mon May 9 18:58:57 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn3] setShardVersion failed! Mon May 9 18:58:57 [conn3] going to retry checkShardVersion Mon May 9 18:58:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:57 [conn22] setShardVersion failed! Mon May 9 18:58:57 [conn22] going to retry checkShardVersion Mon May 9 18:58:57 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:57 [conn3] setShardVersion failed! Mon May 9 18:58:57 [conn3] going to retry checkShardVersion Mon May 9 18:58:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:57 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:57 [conn22] setShardVersion failed! Mon May 9 18:58:57 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:58:57 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:57 [conn3] setShardVersion failed! Mon May 9 18:58:57 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:58:57 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:57 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:58:57 [conn3] setShardVersion success! Mon May 9 18:58:57 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:58:57 BackgroundJob starting: ConnectBG Mon May 9 18:58:58 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:58 [conn3] setShardVersion failed! Mon May 9 18:58:58 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:58 BackgroundJob starting: ConnectBG Mon May 9 18:58:58 [conn3] setShardVersion failed! Mon May 9 18:58:58 [conn3] going to retry checkShardVersion Mon May 9 18:58:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:58 [conn22] setShardVersion failed! Mon May 9 18:58:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:58 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn22] setShardVersion failed! Mon May 9 18:58:58 [conn22] going to retry checkShardVersion Mon May 9 18:58:58 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:58 [conn3] setShardVersion failed! Mon May 9 18:58:58 [conn3] going to retry checkShardVersion Mon May 9 18:58:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:58 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn22] setShardVersion failed! Mon May 9 18:58:58 [conn22] going to retry checkShardVersion Mon May 9 18:58:58 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:58:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:58 [conn3] setShardVersion failed! Mon May 9 18:58:58 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:58:58 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:58 [conn22] setShardVersion failed! Mon May 9 18:58:58 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:58:58 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:58 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:58:58 [conn3] setShardVersion success! Mon May 9 18:58:58 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "dailyDeals", bucketId: "campaigns", variationId: "_default" } Mon May 9 18:58:58 BackgroundJob starting: ConnectBG Mon May 9 18:58:59 [WriteBackListener] creating new connection to:mongodb04.example.com:27018 Mon May 9 18:58:59 BackgroundJob starting: ConnectBG Mon May 9 18:58:59 BackgroundJob starting: ConnectBG Mon May 9 18:58:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:59 [conn22] setShardVersion failed! Mon May 9 18:58:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:59 [conn22] setShardVersion failed! Mon May 9 18:58:59 [conn22] going to retry checkShardVersion Mon May 9 18:58:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:59 [conn22] setShardVersion failed! Mon May 9 18:58:59 [conn22] going to retry checkShardVersion Mon May 9 18:58:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:58:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:58:59 [conn22] setShardVersion failed! Mon May 9 18:58:59 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:59 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:58:59 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:58:59 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: caught exception mongodb04.example.com:27018 DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { ismaster: 1 } Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] _check : 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: false, secondary: true, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:00 BackgroundJob starting: ConnectBG Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] reconnect mongodb04.example.com:27018 ok Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb04.example.com:27018 { setName: "2", ismaster: false, secondary: true, hosts: [ "mongodb04.example.com:27018", "mongodb05.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed Mon May 9 18:59:00 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: caught exception mongodb04.example.com:27018 DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { ismaster: 1 } Mon May 9 18:59:00 BackgroundJob starting: ConnectBG Mon May 9 18:59:00 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:00 [conn22] setShardVersion failed! Mon May 9 18:59:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:01 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:01 [conn22] setShardVersion failed! Mon May 9 18:59:01 [conn22] going to retry checkShardVersion Mon May 9 18:59:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:01 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:01 [conn22] setShardVersion failed! Mon May 9 18:59:01 [conn22] going to retry checkShardVersion Mon May 9 18:59:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:01 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:01 [conn22] setShardVersion failed! Mon May 9 18:59:01 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:01 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:01 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:01 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:01 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: false, secondary: true, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:01 BackgroundJob starting: ConnectBG Mon May 9 18:59:01 [ReplicaSetMonitorWatcher] reconnect mongodb04.example.com:27018 ok Mon May 9 18:59:02 BackgroundJob starting: ConnectBG Mon May 9 18:59:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:02 [conn22] setShardVersion failed! Mon May 9 18:59:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:02 [conn22] setShardVersion failed! Mon May 9 18:59:02 [conn22] going to retry checkShardVersion Mon May 9 18:59:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:02 [conn22] setShardVersion failed! Mon May 9 18:59:02 [conn22] going to retry checkShardVersion Mon May 9 18:59:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:02 [conn22] setShardVersion failed! Mon May 9 18:59:02 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:02 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:02 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:02 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb04.example.com:27018 { setName: "2", ismaster: false, secondary: true, hosts: [ "mongodb04.example.com:27018", "mongodb05.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:03 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 18:59:03 BackgroundJob starting: ConnectBG Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] going to retry checkShardVersion Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] going to retry checkShardVersion Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:03 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:03 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:03 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:03 BackgroundJob starting: ConnectBG Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] going to retry checkShardVersion Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] going to retry checkShardVersion Mon May 9 18:59:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:03 [conn22] setShardVersion failed! Mon May 9 18:59:03 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:03 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:03 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:03 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:04 BackgroundJob starting: ConnectBG Mon May 9 18:59:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:04 [conn22] setShardVersion failed! Mon May 9 18:59:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:04 [conn22] setShardVersion failed! Mon May 9 18:59:04 [conn22] going to retry checkShardVersion Mon May 9 18:59:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:04 [conn22] setShardVersion failed! Mon May 9 18:59:04 [conn22] going to retry checkShardVersion Mon May 9 18:59:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:05 [conn22] setShardVersion failed! Mon May 9 18:59:05 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:05 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:05 [conn3] setShardVersion success! Mon May 9 18:59:05 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] going to retry checkShardVersion Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] going to retry checkShardVersion Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:05 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 BackgroundJob starting: ConnectBG Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] going to retry checkShardVersion Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] going to retry checkShardVersion Mon May 9 18:59:05 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:05 [conn3] setShardVersion failed! Mon May 9 18:59:05 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:05 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:05 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:05 [conn3] setShardVersion success! Mon May 9 18:59:05 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:05 BackgroundJob starting: ConnectBG Mon May 9 18:59:05 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 18:59:05 [conn3] setShardVersion success! Mon May 9 18:59:05 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub01", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:06 BackgroundJob starting: ConnectBG Mon May 9 18:59:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:06 [conn22] setShardVersion failed! Mon May 9 18:59:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:06 [conn22] setShardVersion failed! Mon May 9 18:59:06 [conn22] going to retry checkShardVersion Mon May 9 18:59:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:06 [conn22] setShardVersion failed! Mon May 9 18:59:06 [conn22] going to retry checkShardVersion Mon May 9 18:59:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:06 [conn22] setShardVersion failed! Mon May 9 18:59:06 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:06 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:06 [conn3] setShardVersion success! Mon May 9 18:59:06 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] going to retry checkShardVersion Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] going to retry checkShardVersion Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:06 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 BackgroundJob starting: ConnectBG Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] going to retry checkShardVersion Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] going to retry checkShardVersion Mon May 9 18:59:06 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:06 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:06 [conn3] setShardVersion failed! Mon May 9 18:59:06 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:06 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:06 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:06 [conn3] setShardVersion success! Mon May 9 18:59:06 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:06 BackgroundJob starting: ConnectBG Mon May 9 18:59:07 BackgroundJob starting: ConnectBG Mon May 9 18:59:07 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:07 [conn22] setShardVersion failed! Mon May 9 18:59:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:07 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:07 [conn22] setShardVersion failed! Mon May 9 18:59:07 [conn22] going to retry checkShardVersion Mon May 9 18:59:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:07 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:07 [conn22] setShardVersion failed! Mon May 9 18:59:07 [conn22] going to retry checkShardVersion Mon May 9 18:59:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:07 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:07 [conn22] setShardVersion failed! Mon May 9 18:59:07 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:07 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:07 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:07 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:08 BackgroundJob starting: ConnectBG Mon May 9 18:59:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:08 [conn22] setShardVersion failed! Mon May 9 18:59:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:08 [conn22] setShardVersion failed! Mon May 9 18:59:08 [conn22] going to retry checkShardVersion Mon May 9 18:59:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:08 [conn22] setShardVersion failed! Mon May 9 18:59:08 [conn22] going to retry checkShardVersion Mon May 9 18:59:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:08 [conn22] setShardVersion failed! Mon May 9 18:59:08 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:08 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:08 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:08 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:09 [conn3] setShardVersion success! Mon May 9 18:59:09 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] going to retry checkShardVersion Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] going to retry checkShardVersion Mon May 9 18:59:09 BackgroundJob starting: ConnectBG Mon May 9 18:59:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:09 [conn22] setShardVersion failed! Mon May 9 18:59:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn22] setShardVersion failed! Mon May 9 18:59:09 [conn22] going to retry checkShardVersion Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:09 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:09 BackgroundJob starting: ConnectBG Mon May 9 18:59:09 [conn22] setShardVersion failed! Mon May 9 18:59:09 [conn22] going to retry checkShardVersion Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbf94003610 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbf94003610 Mon May 9 18:59:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] going to retry checkShardVersion Mon May 9 18:59:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn22] setShardVersion failed! Mon May 9 18:59:09 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:09 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbf94003610 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] going to retry checkShardVersion Mon May 9 18:59:09 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbf94003610 Mon May 9 18:59:09 [conn3] setShardVersion failed! Mon May 9 18:59:09 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:09 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:09 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:09 [conn3] setShardVersion success! Mon May 9 18:59:09 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:09 BackgroundJob starting: ConnectBG Mon May 9 18:59:10 BackgroundJob starting: ConnectBG Mon May 9 18:59:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:10 [conn22] setShardVersion failed! Mon May 9 18:59:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:10 [conn22] setShardVersion failed! Mon May 9 18:59:10 [conn22] going to retry checkShardVersion Mon May 9 18:59:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:10 [conn22] setShardVersion failed! Mon May 9 18:59:10 [conn22] going to retry checkShardVersion Mon May 9 18:59:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:11 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:11 [conn22] setShardVersion failed! Mon May 9 18:59:11 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:11 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:11 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:11 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:12 BackgroundJob starting: ConnectBG Mon May 9 18:59:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:12 [conn22] setShardVersion failed! Mon May 9 18:59:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:12 [conn22] setShardVersion failed! Mon May 9 18:59:12 [conn22] going to retry checkShardVersion Mon May 9 18:59:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:12 [conn22] setShardVersion failed! Mon May 9 18:59:12 [conn22] going to retry checkShardVersion Mon May 9 18:59:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:12 [conn22] setShardVersion failed! Mon May 9 18:59:12 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:12 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:12 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:12 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:13 BackgroundJob starting: ConnectBG Mon May 9 18:59:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:13 [conn22] setShardVersion failed! Mon May 9 18:59:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:13 [conn22] setShardVersion failed! Mon May 9 18:59:13 [conn22] going to retry checkShardVersion Mon May 9 18:59:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:13 [conn22] setShardVersion failed! Mon May 9 18:59:13 [conn22] going to retry checkShardVersion Mon May 9 18:59:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:13 [conn22] setShardVersion failed! Mon May 9 18:59:13 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:13 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:13 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:13 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:14 BackgroundJob starting: ConnectBG Mon May 9 18:59:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:14 [conn22] setShardVersion failed! Mon May 9 18:59:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:14 [conn22] setShardVersion failed! Mon May 9 18:59:14 [conn22] going to retry checkShardVersion Mon May 9 18:59:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:14 [conn22] setShardVersion failed! Mon May 9 18:59:14 [conn22] going to retry checkShardVersion Mon May 9 18:59:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:14 [conn22] setShardVersion failed! Mon May 9 18:59:14 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:14 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:14 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:14 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:15 BackgroundJob starting: ConnectBG Mon May 9 18:59:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:15 [conn22] setShardVersion failed! Mon May 9 18:59:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:15 [conn22] setShardVersion failed! Mon May 9 18:59:15 [conn22] going to retry checkShardVersion Mon May 9 18:59:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:15 [conn22] setShardVersion failed! Mon May 9 18:59:15 [conn22] going to retry checkShardVersion Mon May 9 18:59:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:15 [conn22] setShardVersion failed! Mon May 9 18:59:15 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:15 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:15 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:15 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:16 BackgroundJob starting: ConnectBG Mon May 9 18:59:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:16 [conn22] setShardVersion failed! Mon May 9 18:59:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:16 [conn22] setShardVersion failed! Mon May 9 18:59:16 [conn22] going to retry checkShardVersion Mon May 9 18:59:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:16 [conn22] setShardVersion failed! Mon May 9 18:59:16 [conn22] going to retry checkShardVersion Mon May 9 18:59:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:16 [conn22] setShardVersion failed! Mon May 9 18:59:16 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:16 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:16 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:16 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:17 BackgroundJob starting: ConnectBG Mon May 9 18:59:17 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:17 [conn22] setShardVersion failed! Mon May 9 18:59:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:18 [conn22] setShardVersion failed! Mon May 9 18:59:18 [conn22] going to retry checkShardVersion Mon May 9 18:59:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:18 [conn22] setShardVersion failed! Mon May 9 18:59:18 [conn22] going to retry checkShardVersion Mon May 9 18:59:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:18 [conn22] setShardVersion failed! Mon May 9 18:59:18 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:18 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:18 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:18 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:18 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 18:59:18 [conn22] setShardVersion success! Mon May 9 18:59:18 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83986d2dbf0a3ab449ebf'), userId: "8995e1a6-124f-60f2-8231-0890e30595c1", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "clickThrough", timestamp: 1304967558265 } Mon May 9 18:59:18 BackgroundJob starting: ConnectBG Mon May 9 18:59:18 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 18:59:18 [conn22] setShardVersion success! Mon May 9 18:59:18 [conn22] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:18 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 18:59:18 [conn22] setShardVersion success! Mon May 9 18:59:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:18 [conn22] setShardVersion failed! Mon May 9 18:59:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] going to retry checkShardVersion Mon May 9 18:59:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] going to retry checkShardVersion Mon May 9 18:59:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:19 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:19 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] going to retry checkShardVersion Mon May 9 18:59:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] going to retry checkShardVersion Mon May 9 18:59:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:19 [conn22] setShardVersion failed! Mon May 9 18:59:19 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:19 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:19 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:19 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:20 BackgroundJob starting: ConnectBG Mon May 9 18:59:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:20 [conn22] setShardVersion failed! Mon May 9 18:59:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:20 [conn22] setShardVersion failed! Mon May 9 18:59:20 [conn22] going to retry checkShardVersion Mon May 9 18:59:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:20 [conn22] setShardVersion failed! Mon May 9 18:59:20 [conn22] going to retry checkShardVersion Mon May 9 18:59:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:20 [conn22] setShardVersion failed! Mon May 9 18:59:20 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:20 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:20 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:20 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:21 BackgroundJob starting: ConnectBG Mon May 9 18:59:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:21 [conn22] setShardVersion failed! Mon May 9 18:59:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:21 [conn22] setShardVersion failed! Mon May 9 18:59:21 [conn22] going to retry checkShardVersion Mon May 9 18:59:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:21 [conn22] setShardVersion failed! Mon May 9 18:59:21 [conn22] going to retry checkShardVersion Mon May 9 18:59:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13fe220 Mon May 9 18:59:21 [conn22] setShardVersion failed! Mon May 9 18:59:21 [conn22] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:21 [conn22] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:21 [conn22] ~ScopedDBConnection: _conn != null Mon May 9 18:59:21 [conn22] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:22 [conn3] setShardVersion success! Mon May 9 18:59:22 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa000de40 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa000de40 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] going to retry checkShardVersion Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa000de40 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] going to retry checkShardVersion Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa000de40 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:22 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa012c970 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa012c970 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] going to retry checkShardVersion Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa012c970 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] going to retry checkShardVersion Mon May 9 18:59:22 [conn3] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa012c970 Mon May 9 18:59:22 [conn3] setShardVersion failed! Mon May 9 18:59:22 [conn3] setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] Assertion: 10429:setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] ~ScopedDBConnection: _conn != null Mon May 9 18:59:22 [conn3] AssertionException in process: setShardVersion failed host[2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 18:59:22 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:22 [conn3] setShardVersion success! Mon May 9 18:59:22 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb04.example.com:27018 { setName: "2", ismaster: false, secondary: true, hosts: [ "mongodb04.example.com:27018", "mongodb05.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], primary: "mongodb05.example.com:27018", maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:22 [conn22] setShardVersion failed! Mon May 9 18:59:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 18:59:22 [Balancer] SyncClusterConnection connecting to [mongodb-config03.example.com:27019] Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [Balancer] SyncClusterConnection connecting to [mongodb-config02.example.com:27019] Mon May 9 18:59:22 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 18:59:22 [conn22] setShardVersion success! Mon May 9 18:59:22 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:22 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [Balancer] SyncClusterConnection connecting to [mongodb-config01.example.com:27019] Mon May 9 18:59:22 BackgroundJob starting: ConnectBG Mon May 9 18:59:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 18:59:23 [conn22] setShardVersion success! Mon May 9 18:59:23 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 18:59:23 [conn22] setShardVersion success! Mon May 9 18:59:23 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 18:59:23 [conn22] setShardVersion success! Mon May 9 18:59:23 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 18:59:23 [conn22] setShardVersion success! Mon May 9 18:59:23 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 18:59:23 [conn22] MessagingPort recv() errno:104 Connection reset by peer 10.84.55.204:27018 Mon May 9 18:59:23 [conn22] SocketException: remote: error: 9001 socket exception [1] Mon May 9 18:59:23 [conn22] DBClientCursor::init call() failed Mon May 9 18:59:23 [conn22] AssertionException in process: DBClientBase::findOne: transport error: mongodb04.example.com:27018 query: { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } Mon May 9 18:59:23 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 18:59:23 [conn22] setShardVersion success! Mon May 9 18:59:23 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc8398bd2dbf0a3ab449ec0'), userId: "9e278fd0-ec94-77a2-a15f-c073a2b3a753", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "click", timestamp: 1304967563741 } Mon May 9 18:59:24 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 18:59:24 [conn3] setShardVersion success! Mon May 9 18:59:24 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 18:59:26 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 18:59:26 BackgroundJob starting: ConnectBG Mon May 9 18:59:26 [conn3] setShardVersion success! Mon May 9 18:59:26 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 18:59:33 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 18:59:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 18:59:47 BackgroundJob starting: ConnectBG Mon May 9 18:59:48 [conn26] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x13740a0 Mon May 9 18:59:48 BackgroundJob starting: ConnectBG Mon May 9 18:59:48 [conn26] setShardVersion success! Mon May 9 18:59:48 [conn26] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:48 [conn26] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x136f620 Mon May 9 18:59:48 [conn26] setShardVersion success! Mon May 9 18:59:48 [conn26] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x13fb070 Mon May 9 18:59:48 [conn26] setShardVersion success! Mon May 9 18:59:48 [conn26] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x1384480 Mon May 9 18:59:48 [conn26] setShardVersion success! Mon May 9 18:59:51 BackgroundJob starting: ConnectBG Mon May 9 18:59:51 BackgroundJob starting: ConnectBG Mon May 9 18:59:51 [conn23] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140fab0 Mon May 9 18:59:51 [conn23] setShardVersion success! Mon May 9 18:59:51 [conn23] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:51 [conn23] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x1405710 Mon May 9 18:59:51 [conn23] setShardVersion success! Mon May 9 18:59:51 [conn23] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1384c20 Mon May 9 18:59:51 [conn23] setShardVersion success! Mon May 9 18:59:51 [conn23] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x140f880 Mon May 9 18:59:51 [conn23] setShardVersion success! Mon May 9 18:59:51 [conn23] setShardVersion 4 mongodb10.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140b570 Mon May 9 18:59:51 [conn23] setShardVersion success! Mon May 9 18:59:52 [conn23] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1384c20 Mon May 9 18:59:52 [conn23] setShardVersion success! Mon May 9 18:59:52 [conn23] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:52 [conn23] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x1405710 Mon May 9 18:59:52 [conn23] setShardVersion success! Mon May 9 18:59:52 [conn23] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x140f880 Mon May 9 18:59:52 [conn23] setShardVersion success! Mon May 9 18:59:52 [conn23] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140fab0 Mon May 9 18:59:52 [conn23] setShardVersion success! Mon May 9 18:59:52 [conn23] setShardVersion 4 mongodb10.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140b570 Mon May 9 18:59:52 [conn23] setShardVersion success! Mon May 9 18:59:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 18:59:55 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 18:59:55 [conn3] setShardVersion success! Mon May 9 18:59:55 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 18:59:55 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 18:59:55 [conn3] setShardVersion success! Mon May 9 19:00:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:03 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:00:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:00:33 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:00:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:00:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:01:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:03 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:01:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:01:34 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:01:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:01:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:02:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:04 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:02:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:02:30 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:02:34 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:02:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:02:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:03:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:04 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:03:16 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:17 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:18 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:21 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:03:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:03:35 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:03:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:03:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:03:59 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:04:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:05 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:04:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:04:35 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:04:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:04:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:05:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:05 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:05:09 [conn24] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x14100a0 Mon May 9 19:05:09 [conn24] setShardVersion success! Mon May 9 19:05:09 [conn24] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:05:09 [conn24] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1365280 Mon May 9 19:05:09 BackgroundJob starting: ConnectBG Mon May 9 19:05:09 [conn24] setShardVersion success! Mon May 9 19:05:09 [conn24] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x1369e00 Mon May 9 19:05:09 [conn24] setShardVersion success! Mon May 9 19:05:09 [conn24] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fe7c0 Mon May 9 19:05:09 [conn24] setShardVersion success! Mon May 9 19:05:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:05:26 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:05:26 [conn22] setShardVersion success! Mon May 9 19:05:26 [conn22] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:05:26 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:05:26 [conn22] setShardVersion success! Mon May 9 19:05:26 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:05:26 [conn22] setShardVersion success! Mon May 9 19:05:26 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:05:26 [conn22] setShardVersion success! Mon May 9 19:05:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:05:26 [conn22] trying reconnect to mongodb04.example.com:27018 Mon May 9 19:05:26 BackgroundJob starting: ConnectBG Mon May 9 19:05:26 [conn22] reconnect mongodb04.example.com:27018 ok Mon May 9 19:05:26 [conn22] setShardVersion failed! Mon May 9 19:05:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:05:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:05:26 [conn22] setShardVersion failed! Mon May 9 19:05:26 [conn22] going to retry checkShardVersion Mon May 9 19:05:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:05:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:05:26 [conn22] setShardVersion failed! Mon May 9 19:05:26 [conn22] going to retry checkShardVersion Mon May 9 19:05:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:05:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:05:26 [conn22] setShardVersion failed! Mon May 9 19:05:26 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:05:26 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:05:26 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:05:28 [conn23] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1384c20 Mon May 9 19:05:28 [conn23] setShardVersion success! Mon May 9 19:05:28 [conn23] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:05:28 [conn23] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x1405710 Mon May 9 19:05:28 [conn23] setShardVersion success! Mon May 9 19:05:28 [conn23] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x140f880 Mon May 9 19:05:28 [conn23] setShardVersion success! Mon May 9 19:05:28 [conn23] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140fab0 Mon May 9 19:05:28 [conn23] setShardVersion success! Mon May 9 19:05:28 [conn23] setShardVersion 4 mongodb10.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140b570 Mon May 9 19:05:28 [conn23] setShardVersion success! Mon May 9 19:05:29 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:05:29 [conn3] setShardVersion success! Mon May 9 19:05:29 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:05:29 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:05:29 [conn3] setShardVersion success! Mon May 9 19:05:29 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:05:29 [conn3] setShardVersion success! Mon May 9 19:05:29 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:05:29 [conn3] setShardVersion success! Mon May 9 19:05:33 [conn23] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x1405710 Mon May 9 19:05:33 [conn23] setShardVersion success! Mon May 9 19:05:33 [conn23] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83afdd2dbf0a3ab449ec8'), userId: "882c0f5c-f598-119e-e7ee-ac2831c4a1ba", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "click", timestamp: 1304967933358 } Mon May 9 19:05:36 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:05:40 [conn25] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x14075f0 Mon May 9 19:05:40 [conn25] setShardVersion success! Mon May 9 19:05:40 [conn25] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:05:40 [conn25] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x135be20 Mon May 9 19:05:40 [conn25] setShardVersion success! Mon May 9 19:05:40 [conn25] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x14071f0 Mon May 9 19:05:40 BackgroundJob starting: ConnectBG Mon May 9 19:05:40 [conn25] setShardVersion success! Mon May 9 19:05:40 [conn25] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x14072a0 Mon May 9 19:05:40 [conn25] setShardVersion success! Mon May 9 19:05:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:05:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:06:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:06 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:06:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:06:36 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:06:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:06:46 [conn23] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1384c20 Mon May 9 19:06:46 [conn23] setShardVersion success! Mon May 9 19:06:46 [conn23] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b46d2dbf0a3ab449ecc'), userId: "e0c9f306-3081-23e3-b0f7-fdcca12ecb51", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "click", timestamp: 1304968006802 } Mon May 9 19:06:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:06:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:06:57 [conn22] setShardVersion success! Mon May 9 19:06:57 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:06:57 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:06:58 [conn22] setShardVersion success! Mon May 9 19:06:58 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:06:58 [conn22] setShardVersion success! Mon May 9 19:06:58 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:06:58 [conn22] setShardVersion success! Mon May 9 19:06:58 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:06:58 [conn22] setShardVersion success! Mon May 9 19:06:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:58 [conn22] setShardVersion failed! Mon May 9 19:06:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:58 [conn22] setShardVersion failed! Mon May 9 19:06:58 [conn22] going to retry checkShardVersion Mon May 9 19:06:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:58 [conn22] setShardVersion failed! Mon May 9 19:06:58 [conn22] going to retry checkShardVersion Mon May 9 19:06:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:58 [conn22] setShardVersion failed! Mon May 9 19:06:58 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:06:58 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:06:58 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:06:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:06:59 [conn22] setShardVersion success! Mon May 9 19:06:59 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:06:59 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:06:59 [conn22] setShardVersion success! Mon May 9 19:06:59 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:06:59 [conn22] setShardVersion success! Mon May 9 19:06:59 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:06:59 [conn22] setShardVersion success! Mon May 9 19:06:59 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:06:59 [conn22] setShardVersion success! Mon May 9 19:06:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:59 [conn22] setShardVersion failed! Mon May 9 19:06:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:59 [conn22] setShardVersion failed! Mon May 9 19:06:59 [conn22] going to retry checkShardVersion Mon May 9 19:06:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:59 [conn22] setShardVersion failed! Mon May 9 19:06:59 [conn22] going to retry checkShardVersion Mon May 9 19:06:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:06:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:06:59 [conn22] setShardVersion failed! Mon May 9 19:06:59 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:06:59 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:06:59 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:00 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:00 [conn3] setShardVersion success! Mon May 9 19:07:00 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_livingSocial_DFA03", bucketId: "groups", variationId: "_default" } Mon May 9 19:07:00 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:00 [conn22] setShardVersion success! Mon May 9 19:07:00 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:00 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:00 [conn22] setShardVersion success! Mon May 9 19:07:00 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:00 [conn22] setShardVersion success! Mon May 9 19:07:00 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:00 [conn22] setShardVersion success! Mon May 9 19:07:00 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:00 [conn22] setShardVersion success! Mon May 9 19:07:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:00 [conn22] setShardVersion failed! Mon May 9 19:07:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:00 [conn22] setShardVersion failed! Mon May 9 19:07:00 [conn22] going to retry checkShardVersion Mon May 9 19:07:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:00 [conn22] setShardVersion failed! Mon May 9 19:07:00 [conn22] going to retry checkShardVersion Mon May 9 19:07:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:00 [conn22] setShardVersion failed! Mon May 9 19:07:00 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:00 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:00 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:01 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:01 [conn22] setShardVersion success! Mon May 9 19:07:01 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:01 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:01 [conn22] setShardVersion success! Mon May 9 19:07:01 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:01 [conn22] setShardVersion success! Mon May 9 19:07:01 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:01 [conn22] setShardVersion success! Mon May 9 19:07:01 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:01 [conn22] setShardVersion success! Mon May 9 19:07:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:01 [conn22] setShardVersion failed! Mon May 9 19:07:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:02 [conn22] setShardVersion failed! Mon May 9 19:07:02 [conn22] going to retry checkShardVersion Mon May 9 19:07:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:02 [conn22] setShardVersion failed! Mon May 9 19:07:02 [conn22] going to retry checkShardVersion Mon May 9 19:07:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:02 [conn22] setShardVersion failed! Mon May 9 19:07:02 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:02 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:02 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:03 [conn22] setShardVersion success! Mon May 9 19:07:03 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:03 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:03 [conn22] setShardVersion success! Mon May 9 19:07:03 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:03 [conn22] setShardVersion success! Mon May 9 19:07:03 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:03 [conn22] setShardVersion success! Mon May 9 19:07:03 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:03 [conn22] setShardVersion success! Mon May 9 19:07:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:03 [conn22] setShardVersion failed! Mon May 9 19:07:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:03 [conn22] setShardVersion failed! Mon May 9 19:07:03 [conn22] going to retry checkShardVersion Mon May 9 19:07:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:03 [conn22] setShardVersion failed! Mon May 9 19:07:03 [conn22] going to retry checkShardVersion Mon May 9 19:07:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:03 [conn22] setShardVersion failed! Mon May 9 19:07:03 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:03 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:03 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:04 [conn22] setShardVersion success! Mon May 9 19:07:04 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:04 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:04 [conn22] setShardVersion success! Mon May 9 19:07:04 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:04 [conn22] setShardVersion success! Mon May 9 19:07:04 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:04 [conn22] setShardVersion success! Mon May 9 19:07:04 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:04 [conn22] setShardVersion success! Mon May 9 19:07:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:04 [conn22] setShardVersion failed! Mon May 9 19:07:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:04 [conn22] setShardVersion failed! Mon May 9 19:07:04 [conn22] going to retry checkShardVersion Mon May 9 19:07:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:04 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:04 [conn3] setShardVersion success! Mon May 9 19:07:04 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:04 [conn22] setShardVersion failed! Mon May 9 19:07:04 [conn22] going to retry checkShardVersion Mon May 9 19:07:04 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:04 [conn3] setShardVersion success! Mon May 9 19:07:04 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:07:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:04 [conn22] setShardVersion failed! Mon May 9 19:07:04 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:04 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:04 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:04 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:04 [conn3] setShardVersion success! Mon May 9 19:07:04 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:07:04 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:04 [conn3] setShardVersion success! Mon May 9 19:07:04 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:07:05 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:05 [conn22] setShardVersion success! Mon May 9 19:07:05 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:05 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:05 [conn22] setShardVersion success! Mon May 9 19:07:05 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:05 [conn22] setShardVersion success! Mon May 9 19:07:05 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:05 [conn22] setShardVersion success! Mon May 9 19:07:05 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:05 [conn22] setShardVersion success! Mon May 9 19:07:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:05 [conn22] setShardVersion failed! Mon May 9 19:07:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:05 [conn22] setShardVersion failed! Mon May 9 19:07:05 [conn22] going to retry checkShardVersion Mon May 9 19:07:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:05 [conn22] setShardVersion failed! Mon May 9 19:07:05 [conn22] going to retry checkShardVersion Mon May 9 19:07:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:05 [conn22] setShardVersion failed! Mon May 9 19:07:05 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:05 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:05 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:06 [conn22] setShardVersion success! Mon May 9 19:07:06 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:06 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:06 [conn22] setShardVersion success! Mon May 9 19:07:06 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:06 [conn22] setShardVersion success! Mon May 9 19:07:06 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:06 [conn22] setShardVersion success! Mon May 9 19:07:06 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:06 [conn22] setShardVersion success! Mon May 9 19:07:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:06 [conn22] setShardVersion failed! Mon May 9 19:07:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:06 [conn22] setShardVersion failed! Mon May 9 19:07:06 [conn22] going to retry checkShardVersion Mon May 9 19:07:06 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:07:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:06 [conn22] setShardVersion failed! Mon May 9 19:07:06 [conn22] going to retry checkShardVersion Mon May 9 19:07:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:07 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:07 [conn22] setShardVersion failed! Mon May 9 19:07:07 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:07 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:07 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:07 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:07 [conn3] setShardVersion success! Mon May 9 19:07:07 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:07 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:07 [conn3] setShardVersion success! Mon May 9 19:07:07 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:07:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:08 [conn22] setShardVersion success! Mon May 9 19:07:08 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:08 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:08 [conn22] setShardVersion success! Mon May 9 19:07:08 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:08 [conn22] setShardVersion success! Mon May 9 19:07:08 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:08 [conn22] setShardVersion success! Mon May 9 19:07:08 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:08 [conn22] setShardVersion success! Mon May 9 19:07:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:08 [conn22] setShardVersion failed! Mon May 9 19:07:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:08 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:08 [conn3] setShardVersion success! Mon May 9 19:07:08 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_livingSocial_DFA04", bucketId: "groups", variationId: "_default" } Mon May 9 19:07:08 [conn22] setShardVersion failed! Mon May 9 19:07:08 [conn22] going to retry checkShardVersion Mon May 9 19:07:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:08 [conn22] setShardVersion failed! Mon May 9 19:07:08 [conn22] going to retry checkShardVersion Mon May 9 19:07:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:08 [conn22] setShardVersion failed! Mon May 9 19:07:08 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:08 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:08 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:09 [conn22] setShardVersion success! Mon May 9 19:07:09 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:09 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:09 [conn22] setShardVersion success! Mon May 9 19:07:09 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:09 [conn22] setShardVersion success! Mon May 9 19:07:09 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:09 [conn22] setShardVersion success! Mon May 9 19:07:09 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:09 [conn22] setShardVersion success! Mon May 9 19:07:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:09 [conn22] setShardVersion failed! Mon May 9 19:07:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:09 [conn22] setShardVersion failed! Mon May 9 19:07:09 [conn22] going to retry checkShardVersion Mon May 9 19:07:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:09 [conn22] setShardVersion failed! Mon May 9 19:07:09 [conn22] going to retry checkShardVersion Mon May 9 19:07:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:09 [conn22] setShardVersion failed! Mon May 9 19:07:09 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:09 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:09 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:09 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:09 [conn3] setShardVersion success! Mon May 9 19:07:09 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:09 [conn3] setShardVersion success! Mon May 9 19:07:09 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:07:09 [conn3] about to initiate autosplit: ns:example.stats at: 2:2/mongodb05.example.com:27018,mongodb04.example.com:27018 lastmod: 80|1 min: { bucketId: "publishers", entityId: "adX", variationId: "SanJose_3_293_293_29509_290_292" } max: { bucketId: MaxKey, entityId: MaxKey, variationId: MaxKey } dataWritten: 40746763 splitThreshold: 188743680 Mon May 9 19:07:09 BackgroundJob starting: ConnectBG Mon May 9 19:07:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:10 [conn22] setShardVersion success! Mon May 9 19:07:10 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:10 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:10 [conn22] setShardVersion success! Mon May 9 19:07:10 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:10 [conn22] setShardVersion success! Mon May 9 19:07:10 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:10 [conn22] setShardVersion success! Mon May 9 19:07:10 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:10 [conn22] setShardVersion success! Mon May 9 19:07:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:10 [conn22] setShardVersion failed! Mon May 9 19:07:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:10 [conn22] setShardVersion failed! Mon May 9 19:07:10 [conn22] going to retry checkShardVersion Mon May 9 19:07:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:10 [conn22] setShardVersion failed! Mon May 9 19:07:10 [conn22] going to retry checkShardVersion Mon May 9 19:07:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:10 [conn22] setShardVersion failed! Mon May 9 19:07:10 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:10 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:10 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:11 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:11 [conn22] setShardVersion success! Mon May 9 19:07:11 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:11 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:11 [conn22] setShardVersion success! Mon May 9 19:07:11 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:11 [conn22] setShardVersion success! Mon May 9 19:07:11 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:11 [conn22] setShardVersion success! Mon May 9 19:07:11 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:11 [conn22] setShardVersion success! Mon May 9 19:07:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:11 [conn22] setShardVersion failed! Mon May 9 19:07:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:11 [conn22] setShardVersion failed! Mon May 9 19:07:11 [conn22] going to retry checkShardVersion Mon May 9 19:07:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:11 [conn22] setShardVersion failed! Mon May 9 19:07:11 [conn22] going to retry checkShardVersion Mon May 9 19:07:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:11 [conn22] setShardVersion failed! Mon May 9 19:07:11 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:11 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:11 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:12 [conn22] setShardVersion success! Mon May 9 19:07:12 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:12 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:12 [conn22] setShardVersion success! Mon May 9 19:07:12 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:12 [conn22] setShardVersion success! Mon May 9 19:07:12 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:12 [conn22] setShardVersion success! Mon May 9 19:07:12 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:12 [conn22] setShardVersion success! Mon May 9 19:07:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:12 [conn22] setShardVersion failed! Mon May 9 19:07:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:12 [conn22] setShardVersion failed! Mon May 9 19:07:12 [conn22] going to retry checkShardVersion Mon May 9 19:07:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:12 [conn22] setShardVersion failed! Mon May 9 19:07:12 [conn22] going to retry checkShardVersion Mon May 9 19:07:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:12 [conn22] setShardVersion failed! Mon May 9 19:07:12 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:12 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:12 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:13 [conn22] setShardVersion success! Mon May 9 19:07:13 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:13 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:13 [conn22] setShardVersion success! Mon May 9 19:07:13 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:13 [conn22] setShardVersion success! Mon May 9 19:07:13 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:13 [conn22] setShardVersion success! Mon May 9 19:07:13 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:13 [conn22] setShardVersion success! Mon May 9 19:07:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:13 [conn22] setShardVersion failed! Mon May 9 19:07:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:14 [conn22] setShardVersion failed! Mon May 9 19:07:14 [conn22] going to retry checkShardVersion Mon May 9 19:07:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:14 [conn22] setShardVersion failed! Mon May 9 19:07:14 [conn22] going to retry checkShardVersion Mon May 9 19:07:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:14 [conn22] setShardVersion failed! Mon May 9 19:07:14 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:14 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:14 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:14 [conn3] chunk not full enough to trigger auto-split Mon May 9 19:07:14 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:14 [conn3] setShardVersion success! Mon May 9 19:07:14 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:07:14 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:14 [conn3] setShardVersion success! Mon May 9 19:07:14 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:07:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:15 [conn22] setShardVersion success! Mon May 9 19:07:15 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:15 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:15 [conn22] setShardVersion success! Mon May 9 19:07:15 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:15 [conn22] setShardVersion success! Mon May 9 19:07:15 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:15 [conn22] setShardVersion success! Mon May 9 19:07:15 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:15 [conn22] setShardVersion success! Mon May 9 19:07:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:15 [conn22] setShardVersion failed! Mon May 9 19:07:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:15 [conn22] setShardVersion failed! Mon May 9 19:07:15 [conn22] going to retry checkShardVersion Mon May 9 19:07:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:15 [conn22] setShardVersion failed! Mon May 9 19:07:15 [conn22] going to retry checkShardVersion Mon May 9 19:07:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:15 [conn22] setShardVersion failed! Mon May 9 19:07:15 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:15 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:15 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:16 [conn22] setShardVersion success! Mon May 9 19:07:16 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:16 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:16 [conn22] setShardVersion success! Mon May 9 19:07:16 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:16 [conn22] setShardVersion success! Mon May 9 19:07:16 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:16 [conn22] setShardVersion success! Mon May 9 19:07:16 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:16 [conn22] setShardVersion success! Mon May 9 19:07:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:16 [conn22] setShardVersion failed! Mon May 9 19:07:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:16 [conn22] setShardVersion failed! Mon May 9 19:07:16 [conn22] going to retry checkShardVersion Mon May 9 19:07:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:16 [conn22] setShardVersion failed! Mon May 9 19:07:16 [conn22] going to retry checkShardVersion Mon May 9 19:07:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:16 [conn22] setShardVersion failed! Mon May 9 19:07:16 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:16 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:16 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:17 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:17 [conn22] setShardVersion success! Mon May 9 19:07:17 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:17 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:17 [conn22] setShardVersion success! Mon May 9 19:07:17 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:17 [conn22] setShardVersion success! Mon May 9 19:07:17 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:17 [conn22] setShardVersion success! Mon May 9 19:07:17 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:17 [conn22] setShardVersion success! Mon May 9 19:07:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:17 [conn22] setShardVersion failed! Mon May 9 19:07:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:17 [conn22] setShardVersion failed! Mon May 9 19:07:17 [conn22] going to retry checkShardVersion Mon May 9 19:07:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:17 [conn22] setShardVersion failed! Mon May 9 19:07:17 [conn22] going to retry checkShardVersion Mon May 9 19:07:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:18 [conn22] setShardVersion failed! Mon May 9 19:07:18 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:18 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:18 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:19 [conn22] setShardVersion success! Mon May 9 19:07:19 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:19 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:19 [conn22] setShardVersion success! Mon May 9 19:07:19 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:19 [conn22] setShardVersion success! Mon May 9 19:07:19 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:19 [conn22] setShardVersion success! Mon May 9 19:07:19 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:19 [conn22] setShardVersion success! Mon May 9 19:07:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:19 [conn22] setShardVersion failed! Mon May 9 19:07:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:19 [conn23] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x140fab0 Mon May 9 19:07:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:19 [conn23] setShardVersion success! Mon May 9 19:07:19 [conn23] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b67d2dbf0a3ab449ece'), userId: "16e20c03-a24e-592e-7cab-ae883410247e", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "clickThrough", timestamp: 1304968039136 } Mon May 9 19:07:19 [conn22] setShardVersion failed! Mon May 9 19:07:19 [conn22] going to retry checkShardVersion Mon May 9 19:07:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:19 [conn22] setShardVersion failed! Mon May 9 19:07:19 [conn22] going to retry checkShardVersion Mon May 9 19:07:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:19 [conn22] setShardVersion failed! Mon May 9 19:07:19 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:19 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:19 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:20 [conn22] setShardVersion success! Mon May 9 19:07:20 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:20 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:20 [conn22] setShardVersion success! Mon May 9 19:07:20 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:20 [conn22] setShardVersion success! Mon May 9 19:07:20 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:20 [conn22] setShardVersion success! Mon May 9 19:07:20 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:20 [conn22] setShardVersion success! Mon May 9 19:07:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:20 [conn22] setShardVersion failed! Mon May 9 19:07:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:20 [conn22] setShardVersion failed! Mon May 9 19:07:20 [conn22] going to retry checkShardVersion Mon May 9 19:07:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:20 [conn22] setShardVersion failed! Mon May 9 19:07:20 [conn22] going to retry checkShardVersion Mon May 9 19:07:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:20 [conn22] setShardVersion failed! Mon May 9 19:07:20 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:20 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:20 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:21 [conn22] setShardVersion success! Mon May 9 19:07:21 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:21 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:21 [conn22] setShardVersion success! Mon May 9 19:07:21 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:21 [conn22] setShardVersion success! Mon May 9 19:07:21 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:21 [conn22] setShardVersion success! Mon May 9 19:07:21 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:21 [conn22] setShardVersion success! Mon May 9 19:07:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:21 [conn22] setShardVersion failed! Mon May 9 19:07:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:21 [conn22] setShardVersion failed! Mon May 9 19:07:21 [conn22] going to retry checkShardVersion Mon May 9 19:07:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:21 [conn22] setShardVersion failed! Mon May 9 19:07:21 [conn22] going to retry checkShardVersion Mon May 9 19:07:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:21 [conn22] setShardVersion failed! Mon May 9 19:07:21 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:21 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:21 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:22 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:22 [conn22] setShardVersion success! Mon May 9 19:07:22 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:22 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:22 [conn22] setShardVersion success! Mon May 9 19:07:22 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:22 [conn22] setShardVersion success! Mon May 9 19:07:22 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:22 [conn22] setShardVersion success! Mon May 9 19:07:22 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:22 [conn22] setShardVersion success! Mon May 9 19:07:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:22 [conn22] setShardVersion failed! Mon May 9 19:07:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:22 [conn22] setShardVersion failed! Mon May 9 19:07:22 [conn22] going to retry checkShardVersion Mon May 9 19:07:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:07:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:22 [conn22] setShardVersion failed! Mon May 9 19:07:22 [conn22] going to retry checkShardVersion Mon May 9 19:07:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:23 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:23 [conn22] setShardVersion failed! Mon May 9 19:07:23 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:23 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:23 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:24 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:24 [conn22] setShardVersion success! Mon May 9 19:07:24 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:24 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:24 [conn22] setShardVersion success! Mon May 9 19:07:24 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:24 [conn22] setShardVersion success! Mon May 9 19:07:24 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:24 [conn22] setShardVersion success! Mon May 9 19:07:24 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:24 [conn22] setShardVersion success! Mon May 9 19:07:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:24 [conn22] setShardVersion failed! Mon May 9 19:07:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:24 [conn22] setShardVersion failed! Mon May 9 19:07:24 [conn22] going to retry checkShardVersion Mon May 9 19:07:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:24 [conn22] setShardVersion failed! Mon May 9 19:07:24 [conn22] going to retry checkShardVersion Mon May 9 19:07:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:24 [conn22] setShardVersion failed! Mon May 9 19:07:24 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:24 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:24 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:25 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:25 [conn22] setShardVersion success! Mon May 9 19:07:25 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:25 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:25 [conn22] setShardVersion success! Mon May 9 19:07:25 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:25 [conn22] setShardVersion success! Mon May 9 19:07:25 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:25 [conn22] setShardVersion success! Mon May 9 19:07:25 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:25 [conn22] setShardVersion success! Mon May 9 19:07:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:25 [conn22] setShardVersion failed! Mon May 9 19:07:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:25 [conn22] setShardVersion failed! Mon May 9 19:07:25 [conn22] going to retry checkShardVersion Mon May 9 19:07:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:25 [conn22] setShardVersion failed! Mon May 9 19:07:25 [conn22] going to retry checkShardVersion Mon May 9 19:07:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:25 [conn22] setShardVersion failed! Mon May 9 19:07:25 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:25 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:25 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:26 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:26 [conn22] setShardVersion success! Mon May 9 19:07:26 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:26 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:26 [conn22] setShardVersion success! Mon May 9 19:07:26 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:26 [conn22] setShardVersion success! Mon May 9 19:07:26 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:26 [conn22] setShardVersion success! Mon May 9 19:07:26 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:26 [conn22] setShardVersion success! Mon May 9 19:07:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:26 [conn22] setShardVersion failed! Mon May 9 19:07:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:26 [conn22] setShardVersion failed! Mon May 9 19:07:26 [conn22] going to retry checkShardVersion Mon May 9 19:07:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:26 [conn22] setShardVersion failed! Mon May 9 19:07:26 [conn22] going to retry checkShardVersion Mon May 9 19:07:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:26 [conn22] setShardVersion failed! Mon May 9 19:07:26 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:26 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:26 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:27 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:27 [conn22] setShardVersion success! Mon May 9 19:07:27 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:27 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:27 [conn22] setShardVersion success! Mon May 9 19:07:27 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:27 [conn22] setShardVersion success! Mon May 9 19:07:27 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:27 [conn22] setShardVersion success! Mon May 9 19:07:27 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:27 [conn22] setShardVersion success! Mon May 9 19:07:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:27 [conn22] setShardVersion failed! Mon May 9 19:07:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:27 [conn22] setShardVersion failed! Mon May 9 19:07:27 [conn22] going to retry checkShardVersion Mon May 9 19:07:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:27 [conn22] setShardVersion failed! Mon May 9 19:07:27 [conn22] going to retry checkShardVersion Mon May 9 19:07:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:28 [conn22] setShardVersion failed! Mon May 9 19:07:28 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:28 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:28 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:29 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:29 [conn22] setShardVersion success! Mon May 9 19:07:29 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:29 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:29 [conn22] setShardVersion success! Mon May 9 19:07:29 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:29 [conn22] setShardVersion success! Mon May 9 19:07:29 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:29 [conn22] setShardVersion success! Mon May 9 19:07:29 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:29 [conn22] setShardVersion success! Mon May 9 19:07:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:29 [conn22] setShardVersion failed! Mon May 9 19:07:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:29 [conn22] setShardVersion failed! Mon May 9 19:07:29 [conn22] going to retry checkShardVersion Mon May 9 19:07:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:29 [conn22] setShardVersion failed! Mon May 9 19:07:29 [conn22] going to retry checkShardVersion Mon May 9 19:07:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:29 [conn22] setShardVersion failed! Mon May 9 19:07:29 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:29 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:29 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:30 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:07:30 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:30 [conn22] setShardVersion success! Mon May 9 19:07:30 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:30 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:30 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:30 [conn3] setShardVersion success! Mon May 9 19:07:30 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:07:30 [conn22] setShardVersion success! Mon May 9 19:07:30 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:30 [conn22] setShardVersion success! Mon May 9 19:07:30 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:30 [conn22] setShardVersion success! Mon May 9 19:07:30 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:30 [conn22] setShardVersion success! Mon May 9 19:07:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:30 [conn22] setShardVersion failed! Mon May 9 19:07:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:30 [conn22] setShardVersion failed! Mon May 9 19:07:30 [conn22] going to retry checkShardVersion Mon May 9 19:07:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:30 [conn22] setShardVersion failed! Mon May 9 19:07:30 [conn22] going to retry checkShardVersion Mon May 9 19:07:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:30 [conn22] setShardVersion failed! Mon May 9 19:07:30 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:30 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:30 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:31 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:31 [conn22] setShardVersion success! Mon May 9 19:07:31 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:31 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:31 [conn22] setShardVersion success! Mon May 9 19:07:31 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:31 [conn22] setShardVersion success! Mon May 9 19:07:31 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:31 [conn22] setShardVersion success! Mon May 9 19:07:31 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:31 [conn22] setShardVersion success! Mon May 9 19:07:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:31 [conn22] setShardVersion failed! Mon May 9 19:07:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:31 [conn22] setShardVersion failed! Mon May 9 19:07:31 [conn22] going to retry checkShardVersion Mon May 9 19:07:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:32 [conn22] setShardVersion failed! Mon May 9 19:07:32 [conn22] going to retry checkShardVersion Mon May 9 19:07:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:32 [conn22] setShardVersion failed! Mon May 9 19:07:32 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:32 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:32 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:32 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:32 [conn3] setShardVersion success! Mon May 9 19:07:32 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:32 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:07:32 [conn3] setShardVersion success! Mon May 9 19:07:32 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:32 [conn3] setShardVersion success! Mon May 9 19:07:32 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:07:32 [conn3] setShardVersion success! Mon May 9 19:07:33 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:33 [conn22] setShardVersion success! Mon May 9 19:07:33 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:33 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:33 [conn22] setShardVersion success! Mon May 9 19:07:33 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:33 [conn22] setShardVersion success! Mon May 9 19:07:33 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:33 [conn22] setShardVersion success! Mon May 9 19:07:33 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:33 [conn22] setShardVersion success! Mon May 9 19:07:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:33 [conn22] setShardVersion failed! Mon May 9 19:07:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:33 [conn22] setShardVersion failed! Mon May 9 19:07:33 [conn22] going to retry checkShardVersion Mon May 9 19:07:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:33 [conn22] setShardVersion failed! Mon May 9 19:07:33 [conn22] going to retry checkShardVersion Mon May 9 19:07:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:33 [conn22] setShardVersion failed! Mon May 9 19:07:33 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:33 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:33 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:33 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:33 [conn3] setShardVersion success! Mon May 9 19:07:33 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:33 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:33 [conn3] setShardVersion success! Mon May 9 19:07:33 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:07:34 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:07:34 [conn3] setShardVersion success! Mon May 9 19:07:34 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub01", bucketId: "ads", variationId: "_default" } Mon May 9 19:07:34 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:34 [conn22] setShardVersion success! Mon May 9 19:07:34 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:34 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:34 [conn22] setShardVersion success! Mon May 9 19:07:34 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:34 [conn22] setShardVersion success! Mon May 9 19:07:34 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:34 [conn22] setShardVersion success! Mon May 9 19:07:34 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:34 [conn22] setShardVersion success! Mon May 9 19:07:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:34 [conn22] setShardVersion failed! Mon May 9 19:07:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:34 [conn22] setShardVersion failed! Mon May 9 19:07:34 [conn22] going to retry checkShardVersion Mon May 9 19:07:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:34 [conn22] setShardVersion failed! Mon May 9 19:07:34 [conn22] going to retry checkShardVersion Mon May 9 19:07:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:34 [conn22] setShardVersion failed! Mon May 9 19:07:34 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:34 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:34 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:35 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:35 [conn22] setShardVersion success! Mon May 9 19:07:35 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:35 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:35 [conn22] setShardVersion success! Mon May 9 19:07:35 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:35 [conn22] setShardVersion success! Mon May 9 19:07:35 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:35 [conn22] setShardVersion success! Mon May 9 19:07:35 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:35 [conn22] setShardVersion success! Mon May 9 19:07:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:35 [conn22] setShardVersion failed! Mon May 9 19:07:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:35 [conn22] setShardVersion failed! Mon May 9 19:07:35 [conn22] going to retry checkShardVersion Mon May 9 19:07:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:35 [conn22] setShardVersion failed! Mon May 9 19:07:35 [conn22] going to retry checkShardVersion Mon May 9 19:07:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:35 [conn22] setShardVersion failed! Mon May 9 19:07:35 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:35 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:35 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:36 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b78d2dbf0a3ab449ecf'), userId: "1b885733-9f73-6324-1b59-5c45f835f877", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "click", timestamp: 1304968056509 } Mon May 9 19:07:36 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:36 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:36 [conn22] setShardVersion success! Mon May 9 19:07:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:36 [conn22] setShardVersion failed! Mon May 9 19:07:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:36 [conn22] setShardVersion failed! Mon May 9 19:07:36 [conn22] going to retry checkShardVersion Mon May 9 19:07:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:36 [conn22] setShardVersion failed! Mon May 9 19:07:36 [conn22] going to retry checkShardVersion Mon May 9 19:07:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:36 [conn22] setShardVersion failed! Mon May 9 19:07:36 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:36 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:36 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:37 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:07:37 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:37 [conn22] setShardVersion success! Mon May 9 19:07:37 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:37 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:37 [conn22] setShardVersion success! Mon May 9 19:07:37 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:37 [conn22] setShardVersion success! Mon May 9 19:07:37 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:37 [conn22] setShardVersion success! Mon May 9 19:07:37 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:37 [conn22] setShardVersion success! Mon May 9 19:07:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:37 [conn22] setShardVersion failed! Mon May 9 19:07:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:37 [conn22] setShardVersion failed! Mon May 9 19:07:37 [conn22] going to retry checkShardVersion Mon May 9 19:07:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:37 [conn22] setShardVersion failed! Mon May 9 19:07:37 [conn22] going to retry checkShardVersion Mon May 9 19:07:38 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:38 [conn22] setShardVersion failed! Mon May 9 19:07:38 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:38 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:38 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:38 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:38 [conn3] setShardVersion success! Mon May 9 19:07:38 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:38 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:38 [conn3] setShardVersion success! Mon May 9 19:07:38 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:07:38 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:38 [conn22] setShardVersion success! Mon May 9 19:07:38 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b7ad2dbf0a3ab449ed0'), userId: "15419685-71a4-7088-fe0c-2978060016c9", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "click", timestamp: 1304968058420 } Mon May 9 19:07:39 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:39 [conn22] setShardVersion success! Mon May 9 19:07:39 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:39 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:39 [conn22] setShardVersion success! Mon May 9 19:07:39 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:39 [conn22] setShardVersion success! Mon May 9 19:07:39 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:39 [conn22] setShardVersion success! Mon May 9 19:07:39 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:39 [conn22] setShardVersion success! Mon May 9 19:07:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:39 [conn22] setShardVersion failed! Mon May 9 19:07:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:39 [conn22] setShardVersion failed! Mon May 9 19:07:39 [conn22] going to retry checkShardVersion Mon May 9 19:07:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:39 [conn22] setShardVersion failed! Mon May 9 19:07:39 [conn22] going to retry checkShardVersion Mon May 9 19:07:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:39 [conn22] setShardVersion failed! Mon May 9 19:07:39 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:39 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:39 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:40 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:40 [conn22] setShardVersion success! Mon May 9 19:07:40 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:40 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:40 [conn22] setShardVersion success! Mon May 9 19:07:40 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:40 [conn22] setShardVersion success! Mon May 9 19:07:40 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:40 [conn22] setShardVersion success! Mon May 9 19:07:40 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:40 [conn22] setShardVersion success! Mon May 9 19:07:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:40 [conn22] setShardVersion failed! Mon May 9 19:07:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:40 [conn22] setShardVersion failed! Mon May 9 19:07:40 [conn22] going to retry checkShardVersion Mon May 9 19:07:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:40 [conn22] setShardVersion failed! Mon May 9 19:07:40 [conn22] going to retry checkShardVersion Mon May 9 19:07:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:40 [conn22] setShardVersion failed! Mon May 9 19:07:40 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:40 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:40 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:41 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:41 [conn22] setShardVersion success! Mon May 9 19:07:41 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:41 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:41 [conn22] setShardVersion success! Mon May 9 19:07:41 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:41 [conn22] setShardVersion success! Mon May 9 19:07:41 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:41 [conn22] setShardVersion success! Mon May 9 19:07:41 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:41 [conn22] setShardVersion success! Mon May 9 19:07:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:41 [conn22] setShardVersion failed! Mon May 9 19:07:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:41 [conn22] setShardVersion failed! Mon May 9 19:07:41 [conn22] going to retry checkShardVersion Mon May 9 19:07:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:41 [conn22] setShardVersion failed! Mon May 9 19:07:41 [conn22] going to retry checkShardVersion Mon May 9 19:07:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:41 [conn22] setShardVersion failed! Mon May 9 19:07:41 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:41 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:41 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:42 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:42 [conn22] setShardVersion success! Mon May 9 19:07:42 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:42 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:42 [conn22] setShardVersion success! Mon May 9 19:07:42 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:42 [conn22] setShardVersion success! Mon May 9 19:07:42 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:42 [conn22] setShardVersion success! Mon May 9 19:07:42 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:42 [conn22] setShardVersion success! Mon May 9 19:07:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:42 [conn22] setShardVersion failed! Mon May 9 19:07:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:42 [conn22] setShardVersion failed! Mon May 9 19:07:42 [conn22] going to retry checkShardVersion Mon May 9 19:07:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:42 [conn22] setShardVersion failed! Mon May 9 19:07:42 [conn22] going to retry checkShardVersion Mon May 9 19:07:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:42 [conn22] setShardVersion failed! Mon May 9 19:07:42 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:42 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:42 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:42 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:07:43 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:43 [conn22] setShardVersion success! Mon May 9 19:07:43 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:43 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:43 [conn22] setShardVersion success! Mon May 9 19:07:43 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:43 [conn22] setShardVersion success! Mon May 9 19:07:43 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:43 [conn22] setShardVersion success! Mon May 9 19:07:43 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:43 [conn22] setShardVersion success! Mon May 9 19:07:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:43 [conn22] setShardVersion failed! Mon May 9 19:07:43 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:43 [conn22] setShardVersion failed! Mon May 9 19:07:43 [conn22] going to retry checkShardVersion Mon May 9 19:07:43 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:44 [conn22] setShardVersion failed! Mon May 9 19:07:44 [conn22] going to retry checkShardVersion Mon May 9 19:07:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:44 [conn22] setShardVersion failed! Mon May 9 19:07:44 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:44 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:44 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:45 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:45 [conn22] setShardVersion success! Mon May 9 19:07:45 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:45 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:45 [conn22] setShardVersion success! Mon May 9 19:07:45 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:45 [conn22] setShardVersion success! Mon May 9 19:07:45 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:45 [conn22] setShardVersion success! Mon May 9 19:07:45 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:45 [conn22] setShardVersion success! Mon May 9 19:07:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:45 [conn22] setShardVersion failed! Mon May 9 19:07:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:45 [conn22] setShardVersion failed! Mon May 9 19:07:45 [conn22] going to retry checkShardVersion Mon May 9 19:07:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:45 [conn22] setShardVersion failed! Mon May 9 19:07:45 [conn22] going to retry checkShardVersion Mon May 9 19:07:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:45 [conn22] setShardVersion failed! Mon May 9 19:07:45 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:45 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:45 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:46 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:46 [conn22] setShardVersion success! Mon May 9 19:07:46 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:46 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:46 [conn22] setShardVersion success! Mon May 9 19:07:46 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:46 [conn22] setShardVersion success! Mon May 9 19:07:46 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:46 [conn22] setShardVersion success! Mon May 9 19:07:46 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:46 [conn22] setShardVersion success! Mon May 9 19:07:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:46 [conn22] setShardVersion failed! Mon May 9 19:07:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:46 [conn22] setShardVersion failed! Mon May 9 19:07:46 [conn22] going to retry checkShardVersion Mon May 9 19:07:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:46 [conn22] setShardVersion failed! Mon May 9 19:07:46 [conn22] going to retry checkShardVersion Mon May 9 19:07:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:46 [conn22] setShardVersion failed! Mon May 9 19:07:46 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:46 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:46 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:47 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:47 [conn22] setShardVersion success! Mon May 9 19:07:47 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:47 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:47 [conn22] setShardVersion success! Mon May 9 19:07:47 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:47 [conn22] setShardVersion success! Mon May 9 19:07:47 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:47 [conn22] setShardVersion success! Mon May 9 19:07:47 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:47 [conn22] setShardVersion success! Mon May 9 19:07:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:47 [conn22] setShardVersion failed! Mon May 9 19:07:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:47 [conn22] setShardVersion failed! Mon May 9 19:07:47 [conn22] going to retry checkShardVersion Mon May 9 19:07:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:47 [conn22] setShardVersion failed! Mon May 9 19:07:47 [conn22] going to retry checkShardVersion Mon May 9 19:07:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:47 [conn22] setShardVersion failed! Mon May 9 19:07:47 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:47 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:47 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:48 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b84d2dbf0a3ab449ed1'), userId: "15419685-71a4-7088-fe0c-2978060016c9", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "clickThrough", timestamp: 1304968068548 } Mon May 9 19:07:48 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:48 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:48 [conn22] setShardVersion success! Mon May 9 19:07:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:48 [conn22] setShardVersion failed! Mon May 9 19:07:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:48 [conn22] setShardVersion failed! Mon May 9 19:07:48 [conn22] going to retry checkShardVersion Mon May 9 19:07:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:48 [conn22] setShardVersion failed! Mon May 9 19:07:48 [conn22] going to retry checkShardVersion Mon May 9 19:07:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:48 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:48 [conn3] setShardVersion success! Mon May 9 19:07:48 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:48 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:07:48 [conn22] setShardVersion failed! Mon May 9 19:07:48 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:48 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:48 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:48 [conn3] setShardVersion success! Mon May 9 19:07:48 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:48 [conn3] setShardVersion success! Mon May 9 19:07:48 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:07:48 [conn3] setShardVersion success! Mon May 9 19:07:49 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:49 [conn22] setShardVersion success! Mon May 9 19:07:49 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:49 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:49 [conn22] setShardVersion success! Mon May 9 19:07:49 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:49 [conn22] setShardVersion success! Mon May 9 19:07:49 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:49 [conn22] setShardVersion success! Mon May 9 19:07:49 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:49 [conn22] setShardVersion success! Mon May 9 19:07:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:49 [conn22] setShardVersion failed! Mon May 9 19:07:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:49 [conn22] setShardVersion failed! Mon May 9 19:07:49 [conn22] going to retry checkShardVersion Mon May 9 19:07:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:49 [conn22] setShardVersion failed! Mon May 9 19:07:49 [conn22] going to retry checkShardVersion Mon May 9 19:07:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:49 [conn22] setShardVersion failed! Mon May 9 19:07:49 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:49 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:49 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:50 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:50 [conn3] setShardVersion success! Mon May 9 19:07:50 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:50 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:07:50 [conn3] setShardVersion success! Mon May 9 19:07:50 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:50 [conn3] setShardVersion success! Mon May 9 19:07:50 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:07:50 [conn3] setShardVersion success! Mon May 9 19:07:51 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:51 [conn22] setShardVersion success! Mon May 9 19:07:51 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:51 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:51 [conn22] setShardVersion success! Mon May 9 19:07:51 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:51 [conn22] setShardVersion success! Mon May 9 19:07:51 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:51 [conn22] setShardVersion success! Mon May 9 19:07:51 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:51 [conn22] setShardVersion success! Mon May 9 19:07:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:51 [conn22] setShardVersion failed! Mon May 9 19:07:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:51 [conn22] setShardVersion failed! Mon May 9 19:07:51 [conn22] going to retry checkShardVersion Mon May 9 19:07:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:51 [conn22] setShardVersion failed! Mon May 9 19:07:51 [conn22] going to retry checkShardVersion Mon May 9 19:07:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:51 [conn22] setShardVersion failed! Mon May 9 19:07:51 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:51 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:51 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:52 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:52 [conn22] setShardVersion success! Mon May 9 19:07:52 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:52 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:52 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:07:52 [conn3] setShardVersion success! Mon May 9 19:07:52 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:07:52 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:07:52 [conn3] setShardVersion success! Mon May 9 19:07:52 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:07:52 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:07:53 [conn22] setShardVersion success! Mon May 9 19:07:53 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:53 [conn22] setShardVersion success! Mon May 9 19:07:53 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:53 [conn22] setShardVersion success! Mon May 9 19:07:53 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:53 [conn22] setShardVersion success! Mon May 9 19:07:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:53 [conn22] setShardVersion failed! Mon May 9 19:07:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:53 [conn22] setShardVersion failed! Mon May 9 19:07:53 [conn22] going to retry checkShardVersion Mon May 9 19:07:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:53 [conn22] setShardVersion failed! Mon May 9 19:07:53 [conn22] going to retry checkShardVersion Mon May 9 19:07:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:53 [conn22] setShardVersion failed! Mon May 9 19:07:53 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:53 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:53 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:54 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:54 [conn22] setShardVersion success! Mon May 9 19:07:54 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:54 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:54 [conn22] setShardVersion success! Mon May 9 19:07:54 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:54 [conn22] setShardVersion success! Mon May 9 19:07:54 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:54 [conn22] setShardVersion success! Mon May 9 19:07:54 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:54 [conn22] setShardVersion success! Mon May 9 19:07:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:54 [conn22] setShardVersion failed! Mon May 9 19:07:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:54 [conn22] setShardVersion failed! Mon May 9 19:07:54 [conn22] going to retry checkShardVersion Mon May 9 19:07:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:54 [conn22] setShardVersion failed! Mon May 9 19:07:54 [conn22] going to retry checkShardVersion Mon May 9 19:07:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:54 [conn22] setShardVersion failed! Mon May 9 19:07:54 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:54 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:54 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:55 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:55 [conn22] setShardVersion success! Mon May 9 19:07:55 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:55 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:55 [conn22] setShardVersion success! Mon May 9 19:07:55 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:55 [conn22] setShardVersion success! Mon May 9 19:07:55 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:55 [conn22] setShardVersion success! Mon May 9 19:07:55 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:55 [conn22] setShardVersion success! Mon May 9 19:07:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:55 [conn22] setShardVersion failed! Mon May 9 19:07:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:55 [conn22] setShardVersion failed! Mon May 9 19:07:55 [conn22] going to retry checkShardVersion Mon May 9 19:07:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:55 [conn22] setShardVersion failed! Mon May 9 19:07:55 [conn22] going to retry checkShardVersion Mon May 9 19:07:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:55 [conn22] setShardVersion failed! Mon May 9 19:07:55 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:55 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:55 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:56 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:56 [conn22] setShardVersion success! Mon May 9 19:07:56 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:56 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:56 [conn22] setShardVersion success! Mon May 9 19:07:56 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:56 [conn22] setShardVersion success! Mon May 9 19:07:56 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:56 [conn22] setShardVersion success! Mon May 9 19:07:56 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:57 [conn22] setShardVersion success! Mon May 9 19:07:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:57 [conn22] setShardVersion failed! Mon May 9 19:07:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:57 [conn22] setShardVersion failed! Mon May 9 19:07:57 [conn22] going to retry checkShardVersion Mon May 9 19:07:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:57 [conn22] setShardVersion failed! Mon May 9 19:07:57 [conn22] going to retry checkShardVersion Mon May 9 19:07:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:57 [conn22] setShardVersion failed! Mon May 9 19:07:57 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:57 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:57 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:58 [conn22] setShardVersion success! Mon May 9 19:07:58 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:58 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:58 [conn25] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x14072a0 Mon May 9 19:07:58 [conn25] setShardVersion success! Mon May 9 19:07:58 [conn25] ns: example.userEventsJournal ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:58 [conn25] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x135be20 Mon May 9 19:07:58 [conn25] setShardVersion success! Mon May 9 19:07:58 [conn25] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x14071f0 Mon May 9 19:07:58 [conn25] setShardVersion success! Mon May 9 19:07:58 [conn25] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x14075f0 Mon May 9 19:07:58 [conn25] setShardVersion success! Mon May 9 19:07:58 [conn22] setShardVersion success! Mon May 9 19:07:58 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:58 [conn22] setShardVersion success! Mon May 9 19:07:58 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:58 [conn22] setShardVersion success! Mon May 9 19:07:58 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:58 [conn22] setShardVersion success! Mon May 9 19:07:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:58 [conn22] setShardVersion failed! Mon May 9 19:07:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:58 [conn22] setShardVersion failed! Mon May 9 19:07:58 [conn22] going to retry checkShardVersion Mon May 9 19:07:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:58 [conn22] setShardVersion failed! Mon May 9 19:07:58 [conn22] going to retry checkShardVersion Mon May 9 19:07:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:58 [conn22] setShardVersion failed! Mon May 9 19:07:58 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:58 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:58 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:07:59 [conn22] setShardVersion success! Mon May 9 19:07:59 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:07:59 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:07:59 [conn22] setShardVersion success! Mon May 9 19:07:59 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:07:59 [conn22] setShardVersion success! Mon May 9 19:07:59 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:07:59 [conn22] setShardVersion success! Mon May 9 19:07:59 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:07:59 [conn22] setShardVersion success! Mon May 9 19:07:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:59 [conn22] setShardVersion failed! Mon May 9 19:07:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:59 [conn22] setShardVersion failed! Mon May 9 19:07:59 [conn22] going to retry checkShardVersion Mon May 9 19:07:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:59 [conn22] setShardVersion failed! Mon May 9 19:07:59 [conn22] going to retry checkShardVersion Mon May 9 19:07:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:07:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:07:59 [conn22] setShardVersion failed! Mon May 9 19:07:59 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:59 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:07:59 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:00 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:00 [conn22] setShardVersion success! Mon May 9 19:08:00 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:00 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:01 [conn22] setShardVersion success! Mon May 9 19:08:01 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:01 [conn22] setShardVersion success! Mon May 9 19:08:01 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:01 [conn22] setShardVersion success! Mon May 9 19:08:01 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:01 [conn22] setShardVersion success! Mon May 9 19:08:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:01 [conn22] setShardVersion failed! Mon May 9 19:08:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:01 [conn22] setShardVersion failed! Mon May 9 19:08:01 [conn22] going to retry checkShardVersion Mon May 9 19:08:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:01 [conn22] setShardVersion failed! Mon May 9 19:08:01 [conn22] going to retry checkShardVersion Mon May 9 19:08:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:01 [conn22] setShardVersion failed! Mon May 9 19:08:01 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:01 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:01 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:02 [conn22] setShardVersion success! Mon May 9 19:08:02 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:02 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:02 [conn22] setShardVersion success! Mon May 9 19:08:02 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:02 [conn22] setShardVersion success! Mon May 9 19:08:02 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:02 [conn22] setShardVersion success! Mon May 9 19:08:02 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:02 [conn22] setShardVersion success! Mon May 9 19:08:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:02 [conn22] setShardVersion failed! Mon May 9 19:08:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:02 [conn22] setShardVersion failed! Mon May 9 19:08:02 [conn22] going to retry checkShardVersion Mon May 9 19:08:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:02 [conn22] setShardVersion failed! Mon May 9 19:08:02 [conn22] going to retry checkShardVersion Mon May 9 19:08:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:02 [conn22] setShardVersion failed! Mon May 9 19:08:02 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:02 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:02 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:02 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:03 [conn22] setShardVersion success! Mon May 9 19:08:03 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:03 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:03 [conn22] setShardVersion success! Mon May 9 19:08:03 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:03 [conn22] setShardVersion success! Mon May 9 19:08:03 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:03 [conn22] setShardVersion success! Mon May 9 19:08:03 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:03 [conn22] setShardVersion success! Mon May 9 19:08:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:03 [conn22] setShardVersion failed! Mon May 9 19:08:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:03 [conn22] setShardVersion failed! Mon May 9 19:08:03 [conn22] going to retry checkShardVersion Mon May 9 19:08:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:03 [conn22] setShardVersion failed! Mon May 9 19:08:03 [conn22] going to retry checkShardVersion Mon May 9 19:08:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:03 [conn22] setShardVersion failed! Mon May 9 19:08:03 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:03 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:03 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:04 [conn22] setShardVersion success! Mon May 9 19:08:04 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:04 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:04 [conn22] setShardVersion success! Mon May 9 19:08:04 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:04 [conn22] setShardVersion success! Mon May 9 19:08:04 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:04 [conn22] setShardVersion success! Mon May 9 19:08:04 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:05 [conn22] setShardVersion success! Mon May 9 19:08:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:05 [conn22] setShardVersion failed! Mon May 9 19:08:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:05 [conn22] setShardVersion failed! Mon May 9 19:08:05 [conn22] going to retry checkShardVersion Mon May 9 19:08:05 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:05 [conn3] setShardVersion success! Mon May 9 19:08:05 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:05 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:05 [conn3] setShardVersion success! Mon May 9 19:08:05 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:05 [conn22] setShardVersion failed! Mon May 9 19:08:05 [conn22] going to retry checkShardVersion Mon May 9 19:08:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:05 [conn22] setShardVersion failed! Mon May 9 19:08:05 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:05 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:05 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:06 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:06 [conn3] setShardVersion success! Mon May 9 19:08:06 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:06 [conn22] setShardVersion success! Mon May 9 19:08:06 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:06 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:06 [conn22] setShardVersion success! Mon May 9 19:08:06 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:06 [conn22] setShardVersion success! Mon May 9 19:08:06 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:06 [conn22] setShardVersion success! Mon May 9 19:08:06 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:06 [conn22] setShardVersion success! Mon May 9 19:08:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:06 [conn22] setShardVersion failed! Mon May 9 19:08:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:06 [conn22] setShardVersion failed! Mon May 9 19:08:06 [conn22] going to retry checkShardVersion Mon May 9 19:08:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:07 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:07 [conn22] setShardVersion failed! Mon May 9 19:08:07 [conn22] going to retry checkShardVersion Mon May 9 19:08:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:07 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:07 [conn22] setShardVersion failed! Mon May 9 19:08:07 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:07 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:07 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:07 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:08:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:08 [conn22] setShardVersion success! Mon May 9 19:08:08 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:08 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:08 [conn22] setShardVersion success! Mon May 9 19:08:08 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:08 [conn22] setShardVersion success! Mon May 9 19:08:08 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:08 [conn22] setShardVersion success! Mon May 9 19:08:08 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:08 [conn22] setShardVersion success! Mon May 9 19:08:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:08 [conn22] setShardVersion failed! Mon May 9 19:08:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:08 [conn22] setShardVersion failed! Mon May 9 19:08:08 [conn22] going to retry checkShardVersion Mon May 9 19:08:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:08 [conn22] setShardVersion failed! Mon May 9 19:08:08 [conn22] going to retry checkShardVersion Mon May 9 19:08:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:08 [conn22] setShardVersion failed! Mon May 9 19:08:08 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:08 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:08 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:09 [conn22] setShardVersion success! Mon May 9 19:08:09 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:09 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:09 [conn22] setShardVersion success! Mon May 9 19:08:09 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:09 [conn22] setShardVersion success! Mon May 9 19:08:09 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:09 [conn22] setShardVersion success! Mon May 9 19:08:09 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:09 [conn22] setShardVersion success! Mon May 9 19:08:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:09 [conn22] setShardVersion failed! Mon May 9 19:08:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:09 [conn22] setShardVersion failed! Mon May 9 19:08:09 [conn22] going to retry checkShardVersion Mon May 9 19:08:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:09 [conn22] setShardVersion failed! Mon May 9 19:08:09 [conn22] going to retry checkShardVersion Mon May 9 19:08:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:09 [conn22] setShardVersion failed! Mon May 9 19:08:09 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:09 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:09 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:10 [conn22] setShardVersion success! Mon May 9 19:08:10 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:10 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:10 [conn22] setShardVersion success! Mon May 9 19:08:10 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:10 [conn22] setShardVersion success! Mon May 9 19:08:10 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:10 [conn22] setShardVersion success! Mon May 9 19:08:10 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:10 [conn22] setShardVersion success! Mon May 9 19:08:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:10 [conn22] setShardVersion failed! Mon May 9 19:08:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:10 [conn22] setShardVersion failed! Mon May 9 19:08:10 [conn22] going to retry checkShardVersion Mon May 9 19:08:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:11 [conn22] setShardVersion failed! Mon May 9 19:08:11 [conn22] going to retry checkShardVersion Mon May 9 19:08:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:11 [conn22] setShardVersion failed! Mon May 9 19:08:11 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:11 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:11 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:12 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:12 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:12 [conn22] setShardVersion failed! Mon May 9 19:08:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:12 [conn22] setShardVersion failed! Mon May 9 19:08:12 [conn22] going to retry checkShardVersion Mon May 9 19:08:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:12 [conn22] setShardVersion failed! Mon May 9 19:08:12 [conn22] going to retry checkShardVersion Mon May 9 19:08:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:12 [conn22] setShardVersion failed! Mon May 9 19:08:12 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:12 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:12 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:12 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1219, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:12 [conn22] setShardVersion success! Mon May 9 19:08:12 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b9cd2dbf0a3ab449ed2'), userId: "795ec8d9-a015-2d30-7f99-78242192c9bf", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "click", timestamp: 1304968092555 } Mon May 9 19:08:12 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:12 [conn3] setShardVersion success! Mon May 9 19:08:12 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:13 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:13 [conn22] setShardVersion failed! Mon May 9 19:08:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:13 [conn22] setShardVersion failed! Mon May 9 19:08:13 [conn22] going to retry checkShardVersion Mon May 9 19:08:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:13 [conn22] setShardVersion failed! Mon May 9 19:08:13 [conn22] going to retry checkShardVersion Mon May 9 19:08:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:13 [conn22] setShardVersion failed! Mon May 9 19:08:13 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:13 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:13 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:13 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:13 [conn22] setShardVersion success! Mon May 9 19:08:13 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83b9dd2dbf0a3ab449ed3'), userId: "8599090f-30aa-9de9-f088-c1c9727aede3", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "clickThrough", timestamp: 1304968093966 } Mon May 9 19:08:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:14 [conn22] setShardVersion success! Mon May 9 19:08:14 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:14 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:14 [conn22] setShardVersion success! Mon May 9 19:08:14 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:14 [conn22] setShardVersion success! Mon May 9 19:08:14 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:14 [conn22] setShardVersion success! Mon May 9 19:08:14 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:14 [conn22] setShardVersion success! Mon May 9 19:08:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:14 [conn22] setShardVersion failed! Mon May 9 19:08:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:14 [conn22] setShardVersion failed! Mon May 9 19:08:14 [conn22] going to retry checkShardVersion Mon May 9 19:08:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:14 [conn22] setShardVersion failed! Mon May 9 19:08:14 [conn22] going to retry checkShardVersion Mon May 9 19:08:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:15 [conn22] setShardVersion failed! Mon May 9 19:08:15 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:15 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:15 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:16 [conn22] setShardVersion success! Mon May 9 19:08:16 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:16 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:16 [conn22] setShardVersion success! Mon May 9 19:08:16 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:16 [conn22] setShardVersion success! Mon May 9 19:08:16 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:16 [conn22] setShardVersion success! Mon May 9 19:08:16 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:16 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:16 [conn22] setShardVersion success! Mon May 9 19:08:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:16 [conn22] setShardVersion failed! Mon May 9 19:08:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:16 [conn22] setShardVersion failed! Mon May 9 19:08:16 [conn22] going to retry checkShardVersion Mon May 9 19:08:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:16 [conn22] setShardVersion failed! Mon May 9 19:08:16 [conn22] going to retry checkShardVersion Mon May 9 19:08:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:16 [conn22] setShardVersion failed! Mon May 9 19:08:16 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:16 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:16 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:17 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:17 [conn22] setShardVersion success! Mon May 9 19:08:17 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:17 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:17 [conn22] setShardVersion success! Mon May 9 19:08:17 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:17 [conn22] setShardVersion success! Mon May 9 19:08:17 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:17 [conn22] setShardVersion success! Mon May 9 19:08:17 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:17 [conn22] setShardVersion success! Mon May 9 19:08:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:17 [conn22] setShardVersion failed! Mon May 9 19:08:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:17 [conn22] setShardVersion failed! Mon May 9 19:08:17 [conn22] going to retry checkShardVersion Mon May 9 19:08:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:17 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:17 [conn22] setShardVersion failed! Mon May 9 19:08:17 [conn22] going to retry checkShardVersion Mon May 9 19:08:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:17 [conn22] setShardVersion failed! Mon May 9 19:08:17 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:17 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:17 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:17 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:17 [conn3] setShardVersion success! Mon May 9 19:08:17 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:17 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:17 [conn3] setShardVersion success! Mon May 9 19:08:17 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:18 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:18 [conn22] setShardVersion success! Mon May 9 19:08:18 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:18 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:18 [conn22] setShardVersion success! Mon May 9 19:08:18 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:18 [conn22] setShardVersion success! Mon May 9 19:08:18 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:18 [conn22] setShardVersion success! Mon May 9 19:08:18 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:18 [conn22] setShardVersion success! Mon May 9 19:08:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:18 [conn22] setShardVersion failed! Mon May 9 19:08:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:18 [conn22] setShardVersion failed! Mon May 9 19:08:18 [conn22] going to retry checkShardVersion Mon May 9 19:08:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:18 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:18 [conn22] setShardVersion failed! Mon May 9 19:08:18 [conn22] going to retry checkShardVersion Mon May 9 19:08:18 [conn3] setShardVersion success! Mon May 9 19:08:18 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:18 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:18 [conn3] setShardVersion success! Mon May 9 19:08:18 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:18 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:18 [conn3] setShardVersion success! Mon May 9 19:08:18 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:18 [conn22] setShardVersion failed! Mon May 9 19:08:18 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:18 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:18 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:19 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:19 [conn22] setShardVersion success! Mon May 9 19:08:19 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:19 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:20 [conn22] setShardVersion success! Mon May 9 19:08:20 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:20 [conn22] setShardVersion success! Mon May 9 19:08:20 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:20 [conn22] setShardVersion success! Mon May 9 19:08:20 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:20 [conn22] setShardVersion success! Mon May 9 19:08:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:20 [conn22] setShardVersion failed! Mon May 9 19:08:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:20 [conn22] setShardVersion failed! Mon May 9 19:08:20 [conn22] going to retry checkShardVersion Mon May 9 19:08:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:20 [conn22] setShardVersion failed! Mon May 9 19:08:20 [conn22] going to retry checkShardVersion Mon May 9 19:08:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:20 [conn22] setShardVersion failed! Mon May 9 19:08:20 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:20 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:20 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:21 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:21 [conn22] setShardVersion success! Mon May 9 19:08:21 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:21 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:21 [conn22] setShardVersion success! Mon May 9 19:08:21 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:21 [conn22] setShardVersion success! Mon May 9 19:08:21 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:21 [conn22] setShardVersion success! Mon May 9 19:08:21 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:21 [conn22] setShardVersion success! Mon May 9 19:08:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:21 [conn22] setShardVersion failed! Mon May 9 19:08:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:21 [conn22] setShardVersion failed! Mon May 9 19:08:21 [conn22] going to retry checkShardVersion Mon May 9 19:08:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:21 [conn22] setShardVersion failed! Mon May 9 19:08:21 [conn22] going to retry checkShardVersion Mon May 9 19:08:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:21 [conn22] setShardVersion failed! Mon May 9 19:08:21 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:21 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:21 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:22 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:22 [conn3] setShardVersion success! Mon May 9 19:08:22 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:22 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:22 [conn3] setShardVersion success! Mon May 9 19:08:22 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:22 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:22 [conn22] setShardVersion success! Mon May 9 19:08:22 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:22 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:22 [conn22] setShardVersion success! Mon May 9 19:08:22 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:22 [conn22] setShardVersion success! Mon May 9 19:08:22 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:22 [conn22] setShardVersion success! Mon May 9 19:08:22 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:22 [conn22] setShardVersion success! Mon May 9 19:08:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:22 [conn22] setShardVersion failed! Mon May 9 19:08:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:22 [conn22] setShardVersion failed! Mon May 9 19:08:22 [conn22] going to retry checkShardVersion Mon May 9 19:08:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:22 [conn22] setShardVersion failed! Mon May 9 19:08:22 [conn22] going to retry checkShardVersion Mon May 9 19:08:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:22 [conn22] setShardVersion failed! Mon May 9 19:08:22 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:22 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:22 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:22 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:22 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:08:23 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:23 [conn22] setShardVersion success! Mon May 9 19:08:23 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:23 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:23 [conn22] setShardVersion success! Mon May 9 19:08:23 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:23 [conn22] setShardVersion success! Mon May 9 19:08:23 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:23 [conn22] setShardVersion success! Mon May 9 19:08:23 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:23 [conn22] setShardVersion success! Mon May 9 19:08:23 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:23 [conn22] setShardVersion failed! Mon May 9 19:08:23 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:24 [conn22] setShardVersion failed! Mon May 9 19:08:24 [conn22] going to retry checkShardVersion Mon May 9 19:08:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:24 [conn22] setShardVersion failed! Mon May 9 19:08:24 [conn22] going to retry checkShardVersion Mon May 9 19:08:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:24 [conn22] setShardVersion failed! Mon May 9 19:08:24 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:24 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:24 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:25 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:25 [conn22] setShardVersion success! Mon May 9 19:08:25 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:25 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:25 [conn22] setShardVersion success! Mon May 9 19:08:25 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:25 [conn22] setShardVersion success! Mon May 9 19:08:25 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:25 [conn22] setShardVersion success! Mon May 9 19:08:25 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:25 [conn22] setShardVersion success! Mon May 9 19:08:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:25 [conn22] setShardVersion failed! Mon May 9 19:08:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:25 [conn22] setShardVersion failed! Mon May 9 19:08:25 [conn22] going to retry checkShardVersion Mon May 9 19:08:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:25 [conn22] setShardVersion failed! Mon May 9 19:08:25 [conn22] going to retry checkShardVersion Mon May 9 19:08:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:25 [conn22] setShardVersion failed! Mon May 9 19:08:25 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:25 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:25 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:26 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:26 [conn22] setShardVersion success! Mon May 9 19:08:26 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:26 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:26 [conn22] setShardVersion success! Mon May 9 19:08:26 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:26 [conn22] setShardVersion success! Mon May 9 19:08:26 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:26 [conn22] setShardVersion success! Mon May 9 19:08:26 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:26 [conn22] setShardVersion success! Mon May 9 19:08:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:26 [conn22] setShardVersion failed! Mon May 9 19:08:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:26 [conn22] setShardVersion failed! Mon May 9 19:08:26 [conn22] going to retry checkShardVersion Mon May 9 19:08:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:26 [conn22] setShardVersion failed! Mon May 9 19:08:26 [conn22] going to retry checkShardVersion Mon May 9 19:08:26 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:26 [conn3] setShardVersion success! Mon May 9 19:08:26 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:26 [conn22] setShardVersion failed! Mon May 9 19:08:26 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:26 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:26 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:27 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:27 [conn22] setShardVersion success! Mon May 9 19:08:27 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:27 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:27 [conn22] setShardVersion success! Mon May 9 19:08:27 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:27 [conn22] setShardVersion success! Mon May 9 19:08:27 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:27 [conn22] setShardVersion success! Mon May 9 19:08:27 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:27 [conn22] setShardVersion success! Mon May 9 19:08:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:27 [conn22] setShardVersion failed! Mon May 9 19:08:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:27 [conn22] setShardVersion failed! Mon May 9 19:08:27 [conn22] going to retry checkShardVersion Mon May 9 19:08:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:27 [conn22] setShardVersion failed! Mon May 9 19:08:27 [conn22] going to retry checkShardVersion Mon May 9 19:08:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:27 [conn22] setShardVersion failed! Mon May 9 19:08:27 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:27 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:27 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:28 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:28 [conn22] setShardVersion success! Mon May 9 19:08:28 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:28 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:28 [conn22] setShardVersion success! Mon May 9 19:08:28 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:28 [conn22] setShardVersion success! Mon May 9 19:08:28 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:28 [conn22] setShardVersion success! Mon May 9 19:08:28 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:28 [conn22] setShardVersion success! Mon May 9 19:08:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:28 [conn22] setShardVersion failed! Mon May 9 19:08:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:28 [conn22] setShardVersion failed! Mon May 9 19:08:28 [conn22] going to retry checkShardVersion Mon May 9 19:08:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:28 [conn22] setShardVersion failed! Mon May 9 19:08:28 [conn22] going to retry checkShardVersion Mon May 9 19:08:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:28 [conn22] setShardVersion failed! Mon May 9 19:08:28 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:28 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:28 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:28 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:28 [conn3] setShardVersion success! Mon May 9 19:08:28 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:28 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:08:28 [conn3] setShardVersion success! Mon May 9 19:08:28 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:28 [conn3] setShardVersion success! Mon May 9 19:08:28 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:28 [conn3] setShardVersion success! Mon May 9 19:08:29 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:29 [conn22] setShardVersion success! Mon May 9 19:08:29 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:29 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:29 [conn22] setShardVersion success! Mon May 9 19:08:29 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:29 [conn22] setShardVersion success! Mon May 9 19:08:29 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:29 [conn22] setShardVersion success! Mon May 9 19:08:29 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:29 [conn22] setShardVersion success! Mon May 9 19:08:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:29 [conn22] setShardVersion failed! Mon May 9 19:08:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:29 [conn22] setShardVersion failed! Mon May 9 19:08:29 [conn22] going to retry checkShardVersion Mon May 9 19:08:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:30 [conn22] setShardVersion failed! Mon May 9 19:08:30 [conn22] going to retry checkShardVersion Mon May 9 19:08:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:30 [conn22] setShardVersion failed! Mon May 9 19:08:30 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:30 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:30 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:30 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:30 [conn3] setShardVersion success! Mon May 9 19:08:30 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:30 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:30 [conn3] setShardVersion success! Mon May 9 19:08:30 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:30 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:30 [conn3] setShardVersion success! Mon May 9 19:08:30 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:31 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:31 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:31 [conn22] setShardVersion failed! Mon May 9 19:08:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:31 [conn22] setShardVersion failed! Mon May 9 19:08:31 [conn22] going to retry checkShardVersion Mon May 9 19:08:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:31 [conn22] setShardVersion failed! Mon May 9 19:08:31 [conn22] going to retry checkShardVersion Mon May 9 19:08:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:31 [conn22] setShardVersion failed! Mon May 9 19:08:31 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:31 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:31 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:31 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:31 [conn22] setShardVersion success! Mon May 9 19:08:31 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83bafd2dbf0a3ab449ed4'), userId: "1eb36007-6430-4ddb-5757-ee9aae6ef1b6", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "click", timestamp: 1304968111589 } Mon May 9 19:08:31 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:31 [conn3] setShardVersion success! Mon May 9 19:08:31 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:31 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:31 [conn3] setShardVersion success! Mon May 9 19:08:31 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:32 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:32 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:32 [conn22] setShardVersion failed! Mon May 9 19:08:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:32 [conn22] setShardVersion failed! Mon May 9 19:08:32 [conn22] going to retry checkShardVersion Mon May 9 19:08:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:32 [conn22] setShardVersion failed! Mon May 9 19:08:32 [conn22] going to retry checkShardVersion Mon May 9 19:08:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:32 [conn22] setShardVersion failed! Mon May 9 19:08:32 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:32 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:32 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:32 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1217, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:32 [conn22] setShardVersion success! Mon May 9 19:08:32 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83bb0d2dbf0a3ab449ed5'), userId: "8599090f-30aa-9de9-f088-c1c9727aede3", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "click", timestamp: 1304968112887 } Mon May 9 19:08:33 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:33 [conn22] setShardVersion success! Mon May 9 19:08:33 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:33 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:33 [conn22] setShardVersion success! Mon May 9 19:08:33 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:33 [conn22] setShardVersion success! Mon May 9 19:08:33 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:33 [conn22] setShardVersion success! Mon May 9 19:08:33 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:33 [conn22] setShardVersion success! Mon May 9 19:08:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:33 [conn22] setShardVersion failed! Mon May 9 19:08:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:33 [conn22] setShardVersion failed! Mon May 9 19:08:33 [conn22] going to retry checkShardVersion Mon May 9 19:08:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:33 [conn22] setShardVersion failed! Mon May 9 19:08:33 [conn22] going to retry checkShardVersion Mon May 9 19:08:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:33 [conn22] setShardVersion failed! Mon May 9 19:08:33 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:33 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:33 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:34 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:34 [conn22] setShardVersion success! Mon May 9 19:08:34 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:34 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:34 [conn22] setShardVersion success! Mon May 9 19:08:34 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:34 [conn22] setShardVersion success! Mon May 9 19:08:34 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:34 [conn22] setShardVersion success! Mon May 9 19:08:34 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:34 [conn22] setShardVersion success! Mon May 9 19:08:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:34 [conn22] setShardVersion failed! Mon May 9 19:08:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:34 [conn22] setShardVersion failed! Mon May 9 19:08:34 [conn22] going to retry checkShardVersion Mon May 9 19:08:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:34 [conn22] setShardVersion failed! Mon May 9 19:08:34 [conn22] going to retry checkShardVersion Mon May 9 19:08:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:34 [conn22] setShardVersion failed! Mon May 9 19:08:34 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:34 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:34 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:35 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:35 [conn22] setShardVersion success! Mon May 9 19:08:35 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:35 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:35 [conn22] setShardVersion success! Mon May 9 19:08:35 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:35 [conn22] setShardVersion success! Mon May 9 19:08:35 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:35 [conn22] setShardVersion success! Mon May 9 19:08:35 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:35 [conn22] setShardVersion success! Mon May 9 19:08:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:35 [conn22] setShardVersion failed! Mon May 9 19:08:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:35 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:35 [conn22] setShardVersion failed! Mon May 9 19:08:35 [conn22] going to retry checkShardVersion Mon May 9 19:08:35 [conn3] setShardVersion success! Mon May 9 19:08:35 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:35 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:35 [conn3] setShardVersion success! Mon May 9 19:08:35 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:35 [conn22] setShardVersion failed! Mon May 9 19:08:35 [conn22] going to retry checkShardVersion Mon May 9 19:08:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:35 [conn22] setShardVersion failed! Mon May 9 19:08:35 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:35 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:35 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:36 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:36 [conn3] setShardVersion success! Mon May 9 19:08:36 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:36 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:36 [conn3] setShardVersion success! Mon May 9 19:08:36 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:37 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:37 [conn22] setShardVersion success! Mon May 9 19:08:37 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:37 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:37 [conn22] setShardVersion success! Mon May 9 19:08:37 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:37 [conn22] setShardVersion success! Mon May 9 19:08:37 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:37 [conn22] setShardVersion success! Mon May 9 19:08:37 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:37 [conn22] setShardVersion success! Mon May 9 19:08:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:37 [conn22] setShardVersion failed! Mon May 9 19:08:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:37 [conn22] setShardVersion failed! Mon May 9 19:08:37 [conn22] going to retry checkShardVersion Mon May 9 19:08:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:37 [conn22] setShardVersion failed! Mon May 9 19:08:37 [conn22] going to retry checkShardVersion Mon May 9 19:08:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:37 [conn22] setShardVersion failed! Mon May 9 19:08:37 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:37 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:37 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:37 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:08:38 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:38 [conn22] setShardVersion success! Mon May 9 19:08:38 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:38 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:38 [conn22] setShardVersion success! Mon May 9 19:08:38 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:38 [conn22] setShardVersion success! Mon May 9 19:08:38 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:38 [conn22] setShardVersion success! Mon May 9 19:08:38 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:38 [conn22] setShardVersion success! Mon May 9 19:08:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:38 [conn22] setShardVersion failed! Mon May 9 19:08:38 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:38 [conn22] setShardVersion failed! Mon May 9 19:08:38 [conn22] going to retry checkShardVersion Mon May 9 19:08:38 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:38 [conn22] setShardVersion failed! Mon May 9 19:08:38 [conn22] going to retry checkShardVersion Mon May 9 19:08:38 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:38 [conn22] setShardVersion failed! Mon May 9 19:08:38 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:38 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:38 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:39 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:39 [conn22] setShardVersion success! Mon May 9 19:08:39 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:39 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:39 [conn22] setShardVersion success! Mon May 9 19:08:39 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:39 [conn22] setShardVersion success! Mon May 9 19:08:39 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:39 [conn22] setShardVersion success! Mon May 9 19:08:39 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:39 [conn22] setShardVersion success! Mon May 9 19:08:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:39 [conn22] setShardVersion failed! Mon May 9 19:08:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:39 [conn22] setShardVersion failed! Mon May 9 19:08:39 [conn22] going to retry checkShardVersion Mon May 9 19:08:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:39 [conn22] setShardVersion failed! Mon May 9 19:08:39 [conn22] going to retry checkShardVersion Mon May 9 19:08:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:39 [conn22] setShardVersion failed! Mon May 9 19:08:39 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:39 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:39 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:40 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:40 [conn22] setShardVersion success! Mon May 9 19:08:40 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:40 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:40 [conn22] setShardVersion success! Mon May 9 19:08:40 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:40 [conn22] setShardVersion success! Mon May 9 19:08:40 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:40 [conn22] setShardVersion success! Mon May 9 19:08:40 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:40 [conn22] setShardVersion success! Mon May 9 19:08:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:40 [conn22] setShardVersion failed! Mon May 9 19:08:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:40 [conn22] setShardVersion failed! Mon May 9 19:08:40 [conn22] going to retry checkShardVersion Mon May 9 19:08:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:40 [conn22] setShardVersion failed! Mon May 9 19:08:40 [conn22] going to retry checkShardVersion Mon May 9 19:08:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:40 [conn22] setShardVersion failed! Mon May 9 19:08:40 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:40 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:40 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:41 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:41 [conn22] setShardVersion success! Mon May 9 19:08:41 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:41 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:41 [conn22] setShardVersion success! Mon May 9 19:08:41 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:41 [conn22] setShardVersion success! Mon May 9 19:08:41 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:41 [conn22] setShardVersion success! Mon May 9 19:08:41 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:41 [conn22] setShardVersion success! Mon May 9 19:08:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:41 [conn22] setShardVersion failed! Mon May 9 19:08:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:41 [conn22] setShardVersion failed! Mon May 9 19:08:41 [conn22] going to retry checkShardVersion Mon May 9 19:08:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:41 [conn22] setShardVersion failed! Mon May 9 19:08:41 [conn22] going to retry checkShardVersion Mon May 9 19:08:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:41 [conn22] setShardVersion failed! Mon May 9 19:08:41 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:41 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:41 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:42 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:42 [conn22] setShardVersion success! Mon May 9 19:08:42 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:42 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:42 [conn22] setShardVersion success! Mon May 9 19:08:42 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:42 [conn22] setShardVersion success! Mon May 9 19:08:42 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:42 [conn22] setShardVersion success! Mon May 9 19:08:42 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:42 [conn22] setShardVersion success! Mon May 9 19:08:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:42 [conn22] setShardVersion failed! Mon May 9 19:08:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:08:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:43 [conn22] setShardVersion failed! Mon May 9 19:08:43 [conn22] going to retry checkShardVersion Mon May 9 19:08:43 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:43 [conn22] setShardVersion failed! Mon May 9 19:08:43 [conn22] going to retry checkShardVersion Mon May 9 19:08:43 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:43 [conn22] setShardVersion failed! Mon May 9 19:08:43 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:43 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:43 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:44 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:44 [conn22] setShardVersion success! Mon May 9 19:08:44 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:44 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:44 [conn22] setShardVersion success! Mon May 9 19:08:44 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:44 [conn22] setShardVersion success! Mon May 9 19:08:44 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:44 [conn22] setShardVersion success! Mon May 9 19:08:44 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:44 [conn22] setShardVersion success! Mon May 9 19:08:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:44 [conn22] setShardVersion failed! Mon May 9 19:08:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:44 [conn22] setShardVersion failed! Mon May 9 19:08:44 [conn22] going to retry checkShardVersion Mon May 9 19:08:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:44 [conn22] setShardVersion failed! Mon May 9 19:08:44 [conn22] going to retry checkShardVersion Mon May 9 19:08:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:44 [conn22] setShardVersion failed! Mon May 9 19:08:44 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:44 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:44 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:44 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:44 [conn3] setShardVersion success! Mon May 9 19:08:44 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:44 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:44 [conn3] setShardVersion success! Mon May 9 19:08:44 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:45 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:45 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:45 [conn22] setShardVersion failed! Mon May 9 19:08:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:45 [conn22] setShardVersion failed! Mon May 9 19:08:45 [conn22] going to retry checkShardVersion Mon May 9 19:08:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:45 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:45 [conn22] setShardVersion failed! Mon May 9 19:08:45 [conn22] going to retry checkShardVersion Mon May 9 19:08:45 [conn3] setShardVersion success! Mon May 9 19:08:45 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:45 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:45 [conn3] setShardVersion success! Mon May 9 19:08:45 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:45 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:45 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:45 [conn22] setShardVersion failed! Mon May 9 19:08:45 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:45 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:45 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:45 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1185, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:45 [conn22] setShardVersion success! Mon May 9 19:08:45 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83bbdd2dbf0a3ab449ed6'), userId: "ea2e40eb-a27d-1bfa-179b-12a254c41e50", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_baselineRotation06", eventId: "clickThrough", timestamp: 1304968125671 } Mon May 9 19:08:46 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:46 [conn22] setShardVersion success! Mon May 9 19:08:46 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:46 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:46 [conn22] setShardVersion success! Mon May 9 19:08:46 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:46 [conn22] setShardVersion success! Mon May 9 19:08:46 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:46 [conn22] setShardVersion success! Mon May 9 19:08:46 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:46 [conn22] setShardVersion success! Mon May 9 19:08:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:46 [conn22] setShardVersion failed! Mon May 9 19:08:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:46 [conn22] setShardVersion failed! Mon May 9 19:08:46 [conn22] going to retry checkShardVersion Mon May 9 19:08:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:46 [conn22] setShardVersion failed! Mon May 9 19:08:46 [conn22] going to retry checkShardVersion Mon May 9 19:08:46 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:46 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:46 [conn22] setShardVersion failed! Mon May 9 19:08:46 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:46 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:46 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:46 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:46 [conn3] setShardVersion success! Mon May 9 19:08:46 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:46 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:46 [conn3] setShardVersion success! Mon May 9 19:08:46 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:47 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:47 [conn22] setShardVersion success! Mon May 9 19:08:47 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:47 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:47 [conn22] setShardVersion success! Mon May 9 19:08:47 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:47 [conn22] setShardVersion success! Mon May 9 19:08:47 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:47 [conn22] setShardVersion success! Mon May 9 19:08:47 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:47 [conn22] setShardVersion success! Mon May 9 19:08:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:47 [conn22] setShardVersion failed! Mon May 9 19:08:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:47 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:47 [conn22] setShardVersion failed! Mon May 9 19:08:47 [conn22] going to retry checkShardVersion Mon May 9 19:08:47 [conn3] setShardVersion success! Mon May 9 19:08:47 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:47 [conn22] setShardVersion failed! Mon May 9 19:08:47 [conn22] going to retry checkShardVersion Mon May 9 19:08:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:47 [conn22] setShardVersion failed! Mon May 9 19:08:47 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:47 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:47 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:48 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:48 [conn22] setShardVersion success! Mon May 9 19:08:48 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:48 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:48 [conn22] setShardVersion success! Mon May 9 19:08:48 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:48 [conn22] setShardVersion success! Mon May 9 19:08:48 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:48 [conn22] setShardVersion success! Mon May 9 19:08:48 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:48 [conn22] setShardVersion success! Mon May 9 19:08:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:48 [conn22] setShardVersion failed! Mon May 9 19:08:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:48 [conn22] setShardVersion failed! Mon May 9 19:08:48 [conn22] going to retry checkShardVersion Mon May 9 19:08:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:48 [conn22] setShardVersion failed! Mon May 9 19:08:48 [conn22] going to retry checkShardVersion Mon May 9 19:08:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:49 [conn22] setShardVersion failed! Mon May 9 19:08:49 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:49 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:49 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:50 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:50 [conn22] setShardVersion success! Mon May 9 19:08:50 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:50 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:50 [conn22] setShardVersion success! Mon May 9 19:08:50 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:50 [conn22] setShardVersion success! Mon May 9 19:08:50 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:50 [conn22] setShardVersion success! Mon May 9 19:08:50 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:50 [conn22] setShardVersion success! Mon May 9 19:08:50 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:50 [conn22] setShardVersion failed! Mon May 9 19:08:50 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:50 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:50 [conn22] setShardVersion failed! Mon May 9 19:08:50 [conn22] going to retry checkShardVersion Mon May 9 19:08:50 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:50 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:50 [conn22] setShardVersion failed! Mon May 9 19:08:50 [conn22] going to retry checkShardVersion Mon May 9 19:08:50 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:50 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:50 [conn22] setShardVersion failed! Mon May 9 19:08:50 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:50 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:50 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:51 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:51 [conn22] setShardVersion success! Mon May 9 19:08:51 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:51 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:51 [conn22] setShardVersion success! Mon May 9 19:08:51 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:51 [conn22] setShardVersion success! Mon May 9 19:08:51 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:51 [conn22] setShardVersion success! Mon May 9 19:08:51 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:51 [conn22] setShardVersion success! Mon May 9 19:08:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:51 [conn22] setShardVersion failed! Mon May 9 19:08:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:51 [conn22] setShardVersion failed! Mon May 9 19:08:51 [conn22] going to retry checkShardVersion Mon May 9 19:08:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:51 [conn22] setShardVersion failed! Mon May 9 19:08:51 [conn22] going to retry checkShardVersion Mon May 9 19:08:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:51 [conn22] setShardVersion failed! Mon May 9 19:08:51 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:51 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:51 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:51 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:51 [conn3] setShardVersion success! Mon May 9 19:08:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:51 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:51 [conn3] setShardVersion success! Mon May 9 19:08:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:52 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:52 [conn22] setShardVersion success! Mon May 9 19:08:52 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:52 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:52 [conn22] setShardVersion success! Mon May 9 19:08:52 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:52 [conn22] setShardVersion success! Mon May 9 19:08:52 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:52 [conn22] setShardVersion success! Mon May 9 19:08:52 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:52 [conn22] setShardVersion success! Mon May 9 19:08:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:52 [conn22] setShardVersion failed! Mon May 9 19:08:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:52 [conn22] setShardVersion failed! Mon May 9 19:08:52 [conn22] going to retry checkShardVersion Mon May 9 19:08:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:52 [conn22] setShardVersion failed! Mon May 9 19:08:52 [conn22] going to retry checkShardVersion Mon May 9 19:08:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:52 [conn22] setShardVersion failed! Mon May 9 19:08:52 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:52 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:52 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:53 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:08:53 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:53 [conn22] setShardVersion success! Mon May 9 19:08:53 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:53 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:53 [conn22] setShardVersion success! Mon May 9 19:08:53 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:53 [conn22] setShardVersion success! Mon May 9 19:08:53 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:53 [conn22] setShardVersion success! Mon May 9 19:08:53 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:53 [conn22] setShardVersion success! Mon May 9 19:08:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:53 [conn22] setShardVersion failed! Mon May 9 19:08:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:53 [conn22] setShardVersion failed! Mon May 9 19:08:53 [conn22] going to retry checkShardVersion Mon May 9 19:08:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:53 [conn22] setShardVersion failed! Mon May 9 19:08:53 [conn22] going to retry checkShardVersion Mon May 9 19:08:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:53 [conn22] setShardVersion failed! Mon May 9 19:08:53 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:53 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:53 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:54 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:54 [conn3] setShardVersion success! Mon May 9 19:08:54 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:54 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:54 [conn3] setShardVersion success! Mon May 9 19:08:54 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:54 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:54 [conn22] setShardVersion success! Mon May 9 19:08:54 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:54 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:54 [conn22] setShardVersion success! Mon May 9 19:08:54 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:54 [conn22] setShardVersion success! Mon May 9 19:08:54 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:54 [conn22] setShardVersion success! Mon May 9 19:08:54 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:54 [conn22] setShardVersion success! Mon May 9 19:08:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:54 [conn22] setShardVersion failed! Mon May 9 19:08:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:54 [conn22] setShardVersion failed! Mon May 9 19:08:54 [conn22] going to retry checkShardVersion Mon May 9 19:08:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:54 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:54 [conn22] setShardVersion failed! Mon May 9 19:08:54 [conn22] going to retry checkShardVersion Mon May 9 19:08:54 [conn3] setShardVersion success! Mon May 9 19:08:54 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:08:54 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:08:54 [conn3] setShardVersion success! Mon May 9 19:08:54 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:08:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:55 [conn22] setShardVersion failed! Mon May 9 19:08:55 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:55 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:55 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:55 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:08:55 [conn3] setShardVersion success! Mon May 9 19:08:55 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:08:55 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:08:55 [conn3] setShardVersion success! Mon May 9 19:08:55 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:08:56 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:56 [conn22] setShardVersion success! Mon May 9 19:08:56 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:56 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:56 [conn22] setShardVersion success! Mon May 9 19:08:56 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:56 [conn22] setShardVersion success! Mon May 9 19:08:56 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:56 [conn22] setShardVersion success! Mon May 9 19:08:56 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:56 [conn22] setShardVersion success! Mon May 9 19:08:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:56 [conn22] setShardVersion failed! Mon May 9 19:08:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:56 [conn22] setShardVersion failed! Mon May 9 19:08:56 [conn22] going to retry checkShardVersion Mon May 9 19:08:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:56 [conn22] setShardVersion failed! Mon May 9 19:08:56 [conn22] going to retry checkShardVersion Mon May 9 19:08:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:56 [conn22] setShardVersion failed! Mon May 9 19:08:56 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:56 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:56 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:57 [conn22] setShardVersion success! Mon May 9 19:08:57 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:57 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:57 [conn22] setShardVersion success! Mon May 9 19:08:57 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:57 [conn22] setShardVersion success! Mon May 9 19:08:57 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:57 [conn22] setShardVersion success! Mon May 9 19:08:57 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:57 [conn22] setShardVersion success! Mon May 9 19:08:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:57 [conn22] setShardVersion failed! Mon May 9 19:08:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:57 [conn22] setShardVersion failed! Mon May 9 19:08:57 [conn22] going to retry checkShardVersion Mon May 9 19:08:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:57 [conn22] setShardVersion failed! Mon May 9 19:08:57 [conn22] going to retry checkShardVersion Mon May 9 19:08:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:57 [conn22] setShardVersion failed! Mon May 9 19:08:57 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:57 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:57 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:58 [conn22] setShardVersion success! Mon May 9 19:08:58 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:58 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:58 [conn22] setShardVersion success! Mon May 9 19:08:58 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:58 [conn22] setShardVersion success! Mon May 9 19:08:58 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:58 [conn22] setShardVersion success! Mon May 9 19:08:58 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:58 [conn22] setShardVersion success! Mon May 9 19:08:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:58 [conn22] setShardVersion failed! Mon May 9 19:08:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:58 [conn22] setShardVersion failed! Mon May 9 19:08:58 [conn22] going to retry checkShardVersion Mon May 9 19:08:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:58 [conn22] setShardVersion failed! Mon May 9 19:08:58 [conn22] going to retry checkShardVersion Mon May 9 19:08:58 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:58 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:58 [conn22] setShardVersion failed! Mon May 9 19:08:58 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:58 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:58 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:59 [WriteBackListener] writebacklisten result: { noop: true, ok: 1.0 } Mon May 9 19:08:59 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:08:59 [conn22] setShardVersion success! Mon May 9 19:08:59 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:08:59 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:08:59 [conn22] setShardVersion success! Mon May 9 19:08:59 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:08:59 [conn22] setShardVersion success! Mon May 9 19:08:59 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:08:59 [conn22] setShardVersion success! Mon May 9 19:08:59 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:08:59 [conn22] setShardVersion success! Mon May 9 19:08:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:59 [conn22] setShardVersion failed! Mon May 9 19:08:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:59 [conn22] setShardVersion failed! Mon May 9 19:08:59 [conn22] going to retry checkShardVersion Mon May 9 19:08:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:59 [conn22] setShardVersion failed! Mon May 9 19:08:59 [conn22] going to retry checkShardVersion Mon May 9 19:08:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:08:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:08:59 [conn22] setShardVersion failed! Mon May 9 19:08:59 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:59 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:08:59 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:00 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:00 [conn22] setShardVersion success! Mon May 9 19:09:00 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:00 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:00 [conn22] setShardVersion success! Mon May 9 19:09:00 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:00 [conn22] setShardVersion success! Mon May 9 19:09:00 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:00 [conn22] setShardVersion success! Mon May 9 19:09:00 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:00 [conn22] setShardVersion success! Mon May 9 19:09:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:00 [conn22] setShardVersion failed! Mon May 9 19:09:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:01 [conn22] setShardVersion failed! Mon May 9 19:09:01 [conn22] going to retry checkShardVersion Mon May 9 19:09:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:01 [conn22] setShardVersion failed! Mon May 9 19:09:01 [conn22] going to retry checkShardVersion Mon May 9 19:09:01 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:01 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:01 [conn22] setShardVersion failed! Mon May 9 19:09:01 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:01 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:01 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:01 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:01 [conn3] setShardVersion success! Mon May 9 19:09:01 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:01 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:01 [conn3] setShardVersion success! Mon May 9 19:09:01 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:02 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:02 [conn22] setShardVersion success! Mon May 9 19:09:02 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:02 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:02 [conn22] setShardVersion success! Mon May 9 19:09:02 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:02 [conn22] setShardVersion success! Mon May 9 19:09:02 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:02 [conn22] setShardVersion success! Mon May 9 19:09:02 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:02 [conn22] setShardVersion success! Mon May 9 19:09:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:02 [conn22] setShardVersion failed! Mon May 9 19:09:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:02 [conn22] setShardVersion failed! Mon May 9 19:09:02 [conn22] going to retry checkShardVersion Mon May 9 19:09:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:02 [conn22] setShardVersion failed! Mon May 9 19:09:02 [conn22] going to retry checkShardVersion Mon May 9 19:09:02 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:02 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:02 [conn22] setShardVersion failed! Mon May 9 19:09:02 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:02 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:02 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:03 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:03 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:03 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:03 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:03 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:03 [conn22] setShardVersion success! Mon May 9 19:09:03 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:03 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:03 [conn22] setShardVersion success! Mon May 9 19:09:03 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:03 [conn22] setShardVersion success! Mon May 9 19:09:03 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:03 [conn22] setShardVersion success! Mon May 9 19:09:03 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:03 [conn22] setShardVersion success! Mon May 9 19:09:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:03 [conn22] setShardVersion failed! Mon May 9 19:09:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:03 [conn22] setShardVersion failed! Mon May 9 19:09:03 [conn22] going to retry checkShardVersion Mon May 9 19:09:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:03 [conn22] setShardVersion failed! Mon May 9 19:09:03 [conn22] going to retry checkShardVersion Mon May 9 19:09:03 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:03 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:03 [conn22] setShardVersion failed! Mon May 9 19:09:03 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:03 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:03 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:04 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:04 [conn22] setShardVersion success! Mon May 9 19:09:04 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:04 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:04 [conn22] setShardVersion success! Mon May 9 19:09:04 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:04 [conn22] setShardVersion success! Mon May 9 19:09:04 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:04 [conn22] setShardVersion success! Mon May 9 19:09:04 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:04 [conn22] setShardVersion success! Mon May 9 19:09:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:04 [conn22] setShardVersion failed! Mon May 9 19:09:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:04 [conn22] setShardVersion failed! Mon May 9 19:09:04 [conn22] going to retry checkShardVersion Mon May 9 19:09:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:04 [conn22] setShardVersion failed! Mon May 9 19:09:04 [conn22] going to retry checkShardVersion Mon May 9 19:09:04 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:04 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:04 [conn22] setShardVersion failed! Mon May 9 19:09:04 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:04 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:04 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:04 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:04 [conn3] setShardVersion success! Mon May 9 19:09:04 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:05 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:05 [conn22] setShardVersion success! Mon May 9 19:09:05 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:05 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:05 [conn22] setShardVersion success! Mon May 9 19:09:05 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:05 [conn22] setShardVersion success! Mon May 9 19:09:05 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:05 [conn22] setShardVersion success! Mon May 9 19:09:05 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:05 [conn22] setShardVersion success! Mon May 9 19:09:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:05 [conn22] setShardVersion failed! Mon May 9 19:09:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:05 [conn22] setShardVersion failed! Mon May 9 19:09:05 [conn22] going to retry checkShardVersion Mon May 9 19:09:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:05 [conn22] setShardVersion failed! Mon May 9 19:09:05 [conn22] going to retry checkShardVersion Mon May 9 19:09:05 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:05 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:05 [conn22] setShardVersion failed! Mon May 9 19:09:05 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:05 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:05 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:06 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:06 [conn22] setShardVersion success! Mon May 9 19:09:06 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:06 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:06 [conn22] setShardVersion success! Mon May 9 19:09:06 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:06 [conn22] setShardVersion success! Mon May 9 19:09:06 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:06 [conn22] setShardVersion success! Mon May 9 19:09:06 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:06 [conn22] setShardVersion success! Mon May 9 19:09:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:06 [conn22] setShardVersion failed! Mon May 9 19:09:06 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:06 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:06 [conn22] setShardVersion failed! Mon May 9 19:09:06 [conn22] going to retry checkShardVersion Mon May 9 19:09:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:07 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:07 [conn22] setShardVersion failed! Mon May 9 19:09:07 [conn22] going to retry checkShardVersion Mon May 9 19:09:07 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:07 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:07 [conn22] setShardVersion failed! Mon May 9 19:09:07 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:07 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:07 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:07 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:09:08 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:08 [conn22] setShardVersion success! Mon May 9 19:09:08 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:08 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:08 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:09:08 [conn3] setShardVersion success! Mon May 9 19:09:08 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:08 [conn22] setShardVersion success! Mon May 9 19:09:08 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:08 [conn22] setShardVersion success! Mon May 9 19:09:08 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:08 [conn22] setShardVersion success! Mon May 9 19:09:08 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:08 [conn22] setShardVersion success! Mon May 9 19:09:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:08 [conn22] setShardVersion failed! Mon May 9 19:09:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:08 [conn22] setShardVersion failed! Mon May 9 19:09:08 [conn22] going to retry checkShardVersion Mon May 9 19:09:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:08 [conn22] setShardVersion failed! Mon May 9 19:09:08 [conn22] going to retry checkShardVersion Mon May 9 19:09:08 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:08 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:08 [conn22] setShardVersion failed! Mon May 9 19:09:08 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:08 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:08 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:09 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:09 [conn22] setShardVersion success! Mon May 9 19:09:09 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:09 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:09 [conn3] setShardVersion success! Mon May 9 19:09:09 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_livingSocial_DFA03", bucketId: "groups", variationId: "_default" } Mon May 9 19:09:09 [conn22] setShardVersion success! Mon May 9 19:09:09 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:09 [conn22] setShardVersion success! Mon May 9 19:09:09 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:09 [conn22] setShardVersion success! Mon May 9 19:09:09 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:09 [conn22] setShardVersion success! Mon May 9 19:09:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:09 [conn22] setShardVersion failed! Mon May 9 19:09:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:09 [conn22] setShardVersion failed! Mon May 9 19:09:09 [conn22] going to retry checkShardVersion Mon May 9 19:09:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:09 [conn22] setShardVersion failed! Mon May 9 19:09:09 [conn22] going to retry checkShardVersion Mon May 9 19:09:09 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:09 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:09 [conn22] setShardVersion failed! Mon May 9 19:09:09 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:09 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:09 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:09 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:09 [conn3] setShardVersion success! Mon May 9 19:09:09 [conn3] ns: example.stats ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:09 [conn3] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13fdf10 Mon May 9 19:09:09 [conn3] setShardVersion success! Mon May 9 19:09:09 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:09 [conn3] setShardVersion success! Mon May 9 19:09:09 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:09:09 [conn3] setShardVersion success! Mon May 9 19:09:10 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:10 [conn22] setShardVersion success! Mon May 9 19:09:10 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:10 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:10 [conn22] setShardVersion success! Mon May 9 19:09:10 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:10 [conn22] setShardVersion success! Mon May 9 19:09:10 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:10 [conn22] setShardVersion success! Mon May 9 19:09:10 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:10 [conn22] setShardVersion success! Mon May 9 19:09:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:10 [conn22] setShardVersion failed! Mon May 9 19:09:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:10 [conn22] setShardVersion failed! Mon May 9 19:09:10 [conn22] going to retry checkShardVersion Mon May 9 19:09:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:10 [conn22] setShardVersion failed! Mon May 9 19:09:10 [conn22] going to retry checkShardVersion Mon May 9 19:09:10 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:10 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:10 [conn22] setShardVersion failed! Mon May 9 19:09:10 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:10 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:10 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:11 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:11 [conn3] setShardVersion success! Mon May 9 19:09:11 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "caymanIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:11 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:11 [conn3] setShardVersion success! Mon May 9 19:09:11 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:11 [conn3] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x7fbf94002f00 Mon May 9 19:09:11 [conn3] setShardVersion success! Mon May 9 19:09:11 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_caymanIslands_knot_hub02", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:11 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:11 [conn22] setShardVersion success! Mon May 9 19:09:11 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:11 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:11 [conn22] setShardVersion success! Mon May 9 19:09:11 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:11 [conn22] setShardVersion success! Mon May 9 19:09:11 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:11 [conn22] setShardVersion success! Mon May 9 19:09:11 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:11 [conn22] setShardVersion success! Mon May 9 19:09:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:11 [conn22] setShardVersion failed! Mon May 9 19:09:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:11 [conn22] setShardVersion failed! Mon May 9 19:09:11 [conn22] going to retry checkShardVersion Mon May 9 19:09:11 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:11 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:11 [conn22] setShardVersion failed! Mon May 9 19:09:11 [conn22] going to retry checkShardVersion Mon May 9 19:09:12 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:12 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:12 [conn22] setShardVersion failed! Mon May 9 19:09:12 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:12 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:12 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:13 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:13 [conn22] setShardVersion success! Mon May 9 19:09:13 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:13 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:13 [conn22] setShardVersion success! Mon May 9 19:09:13 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:13 [conn22] setShardVersion success! Mon May 9 19:09:13 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:13 [conn22] setShardVersion success! Mon May 9 19:09:13 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:13 [conn22] setShardVersion success! Mon May 9 19:09:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:13 [conn22] setShardVersion failed! Mon May 9 19:09:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:13 [conn22] setShardVersion failed! Mon May 9 19:09:13 [conn22] going to retry checkShardVersion Mon May 9 19:09:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:13 [conn22] setShardVersion failed! Mon May 9 19:09:13 [conn22] going to retry checkShardVersion Mon May 9 19:09:13 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:13 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:13 [conn22] setShardVersion failed! Mon May 9 19:09:13 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:13 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:13 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:14 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:14 [conn22] setShardVersion success! Mon May 9 19:09:14 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:14 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:14 [conn22] setShardVersion success! Mon May 9 19:09:14 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:14 [conn22] setShardVersion success! Mon May 9 19:09:14 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:14 [conn22] setShardVersion success! Mon May 9 19:09:14 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:14 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:14 [conn3] setShardVersion success! Mon May 9 19:09:14 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:14 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:14 [conn3] setShardVersion success! Mon May 9 19:09:14 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:14 [conn22] setShardVersion success! Mon May 9 19:09:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:14 [conn22] setShardVersion failed! Mon May 9 19:09:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:14 [conn22] setShardVersion failed! Mon May 9 19:09:14 [conn22] going to retry checkShardVersion Mon May 9 19:09:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:14 [conn22] setShardVersion failed! Mon May 9 19:09:14 [conn22] going to retry checkShardVersion Mon May 9 19:09:14 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:14 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:14 [conn22] setShardVersion failed! Mon May 9 19:09:14 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:14 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:14 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:15 BackgroundJob starting: ConnectBG Mon May 9 19:09:15 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:15 [conn22] setShardVersion success! Mon May 9 19:09:15 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:15 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:15 [conn22] setShardVersion success! Mon May 9 19:09:15 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:15 [conn22] setShardVersion success! Mon May 9 19:09:15 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:15 [conn22] setShardVersion success! Mon May 9 19:09:15 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:15 [conn22] setShardVersion success! Mon May 9 19:09:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:15 [conn22] setShardVersion failed! Mon May 9 19:09:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:15 [conn22] setShardVersion failed! Mon May 9 19:09:15 [conn22] going to retry checkShardVersion Mon May 9 19:09:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:15 [conn22] setShardVersion failed! Mon May 9 19:09:15 [conn22] going to retry checkShardVersion Mon May 9 19:09:15 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:15 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:15 [conn22] setShardVersion failed! Mon May 9 19:09:15 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:15 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:15 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:16 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:16 [conn22] setShardVersion success! Mon May 9 19:09:16 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:16 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:16 [conn22] setShardVersion success! Mon May 9 19:09:16 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:16 [conn22] setShardVersion success! Mon May 9 19:09:16 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:16 [conn22] setShardVersion success! Mon May 9 19:09:16 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:16 [conn22] setShardVersion success! Mon May 9 19:09:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:16 [conn22] setShardVersion failed! Mon May 9 19:09:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:16 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:16 [conn22] setShardVersion failed! Mon May 9 19:09:16 [conn22] going to retry checkShardVersion Mon May 9 19:09:16 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:17 [conn22] setShardVersion failed! Mon May 9 19:09:17 [conn22] going to retry checkShardVersion Mon May 9 19:09:17 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:17 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:17 [conn22] setShardVersion failed! Mon May 9 19:09:17 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:17 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:17 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:17 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:17 [conn3] setShardVersion success! Mon May 9 19:09:17 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:17 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:17 [conn3] setShardVersion success! Mon May 9 19:09:17 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:18 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:18 [conn22] setShardVersion success! Mon May 9 19:09:18 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:18 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:18 [conn22] setShardVersion success! Mon May 9 19:09:18 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:18 [conn22] setShardVersion success! Mon May 9 19:09:18 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:18 [conn22] setShardVersion success! Mon May 9 19:09:18 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:18 [conn22] setShardVersion success! Mon May 9 19:09:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:18 [conn22] setShardVersion failed! Mon May 9 19:09:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:18 [conn22] setShardVersion failed! Mon May 9 19:09:18 [conn22] going to retry checkShardVersion Mon May 9 19:09:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:18 [conn22] setShardVersion failed! Mon May 9 19:09:18 [conn22] going to retry checkShardVersion Mon May 9 19:09:18 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:18 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:18 [conn22] setShardVersion failed! Mon May 9 19:09:18 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:18 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:18 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:19 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:19 [conn22] setShardVersion success! Mon May 9 19:09:19 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:19 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:19 [conn22] setShardVersion success! Mon May 9 19:09:19 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:19 [conn22] setShardVersion success! Mon May 9 19:09:19 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:19 [conn22] setShardVersion success! Mon May 9 19:09:19 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:19 [conn22] setShardVersion success! Mon May 9 19:09:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:19 [conn22] setShardVersion failed! Mon May 9 19:09:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:19 [conn22] setShardVersion failed! Mon May 9 19:09:19 [conn22] going to retry checkShardVersion Mon May 9 19:09:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:19 [conn22] setShardVersion failed! Mon May 9 19:09:19 [conn22] going to retry checkShardVersion Mon May 9 19:09:19 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:19 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:19 [conn22] setShardVersion failed! Mon May 9 19:09:19 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:19 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:19 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:20 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:20 [conn22] setShardVersion success! Mon May 9 19:09:20 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:20 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:20 [conn22] setShardVersion success! Mon May 9 19:09:20 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:20 [conn22] setShardVersion success! Mon May 9 19:09:20 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:20 [conn22] setShardVersion success! Mon May 9 19:09:20 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:20 [conn22] setShardVersion success! Mon May 9 19:09:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:20 [conn22] setShardVersion failed! Mon May 9 19:09:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:20 [conn22] setShardVersion failed! Mon May 9 19:09:20 [conn22] going to retry checkShardVersion Mon May 9 19:09:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:20 [conn22] setShardVersion failed! Mon May 9 19:09:20 [conn22] going to retry checkShardVersion Mon May 9 19:09:20 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:20 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:20 [conn22] setShardVersion failed! Mon May 9 19:09:20 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:20 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:20 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:20 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:20 [conn3] setShardVersion success! Mon May 9 19:09:20 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:20 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:20 [conn3] setShardVersion success! Mon May 9 19:09:20 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:21 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:21 [conn22] setShardVersion success! Mon May 9 19:09:21 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:21 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:21 [conn22] setShardVersion success! Mon May 9 19:09:21 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:21 [conn22] setShardVersion success! Mon May 9 19:09:21 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:21 [conn22] setShardVersion success! Mon May 9 19:09:21 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:21 [conn22] setShardVersion success! Mon May 9 19:09:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:21 [conn22] setShardVersion failed! Mon May 9 19:09:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:21 [conn22] setShardVersion failed! Mon May 9 19:09:21 [conn22] going to retry checkShardVersion Mon May 9 19:09:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:21 [conn22] setShardVersion failed! Mon May 9 19:09:21 [conn22] going to retry checkShardVersion Mon May 9 19:09:21 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:21 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:21 [conn22] setShardVersion failed! Mon May 9 19:09:21 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:21 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:21 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:22 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userEventsJournal { setShardVersion: "example.userEventsJournal", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 144000|1213, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] retrying insert because of StaleConfigException: { _id: ObjectId('4dc83be2d2dbf0a3ab449ed7'), userId: "2191aaed-3b8f-1313-7272-3f4014ac2493", variationId: "_default", adId: "hal_livingSocial_cookbook_dfa_winning02", eventId: "clickThrough", timestamp: 1304968162257 } Mon May 9 19:09:22 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:22 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:22 [conn22] setShardVersion success! Mon May 9 19:09:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:22 [conn22] setShardVersion failed! Mon May 9 19:09:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:22 [conn22] setShardVersion failed! Mon May 9 19:09:22 [conn22] going to retry checkShardVersion Mon May 9 19:09:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:22 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:22 [conn22] setShardVersion failed! Mon May 9 19:09:22 [conn22] going to retry checkShardVersion Mon May 9 19:09:22 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:23 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:23 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:23 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:09:23 [conn22] setShardVersion failed! Mon May 9 19:09:23 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:23 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:23 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:23 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:23 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:23 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:23 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:23 [conn3] setShardVersion success! Mon May 9 19:09:23 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_livingSocial_DFA04", bucketId: "groups", variationId: "_default" } Mon May 9 19:09:24 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:24 [conn22] setShardVersion success! Mon May 9 19:09:24 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:24 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:24 [conn22] setShardVersion success! Mon May 9 19:09:24 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:24 [conn22] setShardVersion success! Mon May 9 19:09:24 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:24 [conn22] setShardVersion success! Mon May 9 19:09:24 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:24 [conn22] setShardVersion success! Mon May 9 19:09:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:24 [conn22] setShardVersion failed! Mon May 9 19:09:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:24 [conn22] setShardVersion failed! Mon May 9 19:09:24 [conn22] going to retry checkShardVersion Mon May 9 19:09:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:24 [conn22] setShardVersion failed! Mon May 9 19:09:24 [conn22] going to retry checkShardVersion Mon May 9 19:09:24 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:24 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:24 [conn22] setShardVersion failed! Mon May 9 19:09:24 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:24 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:24 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:25 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:25 [conn22] setShardVersion success! Mon May 9 19:09:25 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:25 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:25 [conn22] setShardVersion success! Mon May 9 19:09:25 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:25 [conn22] setShardVersion success! Mon May 9 19:09:25 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:25 [conn22] setShardVersion success! Mon May 9 19:09:25 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:25 [conn22] setShardVersion success! Mon May 9 19:09:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:25 [conn22] setShardVersion failed! Mon May 9 19:09:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:25 [conn22] setShardVersion failed! Mon May 9 19:09:25 [conn22] going to retry checkShardVersion Mon May 9 19:09:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:25 [conn22] setShardVersion failed! Mon May 9 19:09:25 [conn22] going to retry checkShardVersion Mon May 9 19:09:25 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:25 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:25 [conn22] setShardVersion failed! Mon May 9 19:09:25 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:25 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:25 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:26 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:26 [conn22] setShardVersion success! Mon May 9 19:09:26 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:26 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:26 [conn22] setShardVersion success! Mon May 9 19:09:26 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:26 [conn22] setShardVersion success! Mon May 9 19:09:26 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:26 [conn22] setShardVersion success! Mon May 9 19:09:26 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:26 [conn22] setShardVersion success! Mon May 9 19:09:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:26 [conn22] setShardVersion failed! Mon May 9 19:09:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:26 [conn22] setShardVersion failed! Mon May 9 19:09:26 [conn22] going to retry checkShardVersion Mon May 9 19:09:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:26 [conn22] setShardVersion failed! Mon May 9 19:09:26 [conn22] going to retry checkShardVersion Mon May 9 19:09:26 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:26 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:26 [conn22] setShardVersion failed! Mon May 9 19:09:26 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:26 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:26 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:27 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:27 [conn22] setShardVersion success! Mon May 9 19:09:27 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:27 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:27 [conn22] setShardVersion success! Mon May 9 19:09:27 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:27 [conn22] setShardVersion success! Mon May 9 19:09:27 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:27 [conn22] setShardVersion success! Mon May 9 19:09:27 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:27 [conn22] setShardVersion success! Mon May 9 19:09:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:27 [conn22] setShardVersion failed! Mon May 9 19:09:27 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:27 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:27 [conn22] setShardVersion failed! Mon May 9 19:09:27 [conn22] going to retry checkShardVersion Mon May 9 19:09:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:28 [conn22] setShardVersion failed! Mon May 9 19:09:28 [conn22] going to retry checkShardVersion Mon May 9 19:09:28 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:28 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:28 [conn22] setShardVersion failed! Mon May 9 19:09:28 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:28 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:28 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:29 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:29 [conn22] setShardVersion success! Mon May 9 19:09:29 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:29 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:29 [conn22] setShardVersion success! Mon May 9 19:09:29 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:29 [conn22] setShardVersion success! Mon May 9 19:09:29 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:29 [conn22] setShardVersion success! Mon May 9 19:09:29 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:29 [conn22] setShardVersion success! Mon May 9 19:09:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:29 [conn22] setShardVersion failed! Mon May 9 19:09:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:29 [conn22] setShardVersion failed! Mon May 9 19:09:29 [conn22] going to retry checkShardVersion Mon May 9 19:09:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:29 [conn22] setShardVersion failed! Mon May 9 19:09:29 [conn22] going to retry checkShardVersion Mon May 9 19:09:29 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:29 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:29 [conn22] setShardVersion failed! Mon May 9 19:09:29 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:29 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:29 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:30 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:30 [conn22] setShardVersion success! Mon May 9 19:09:30 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:30 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:30 [conn22] setShardVersion success! Mon May 9 19:09:30 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:30 [conn22] setShardVersion success! Mon May 9 19:09:30 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:30 [conn22] setShardVersion success! Mon May 9 19:09:30 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:30 [conn22] setShardVersion success! Mon May 9 19:09:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:30 [conn22] setShardVersion failed! Mon May 9 19:09:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:30 [conn22] setShardVersion failed! Mon May 9 19:09:30 [conn22] going to retry checkShardVersion Mon May 9 19:09:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:30 [conn22] setShardVersion failed! Mon May 9 19:09:30 [conn22] going to retry checkShardVersion Mon May 9 19:09:30 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:30 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:30 [conn22] setShardVersion failed! Mon May 9 19:09:30 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:30 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:30 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:31 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:31 [conn22] setShardVersion success! Mon May 9 19:09:31 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:31 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:31 [conn22] setShardVersion success! Mon May 9 19:09:31 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:31 [conn22] setShardVersion success! Mon May 9 19:09:31 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:31 [conn22] setShardVersion success! Mon May 9 19:09:31 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:31 [conn22] setShardVersion success! Mon May 9 19:09:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:31 [conn22] setShardVersion failed! Mon May 9 19:09:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:31 [conn22] setShardVersion failed! Mon May 9 19:09:31 [conn22] going to retry checkShardVersion Mon May 9 19:09:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:31 [conn22] setShardVersion failed! Mon May 9 19:09:31 [conn22] going to retry checkShardVersion Mon May 9 19:09:31 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:31 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:31 [conn22] setShardVersion failed! Mon May 9 19:09:31 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:31 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:31 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:32 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:32 [conn22] setShardVersion success! Mon May 9 19:09:32 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:32 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:32 [conn22] setShardVersion success! Mon May 9 19:09:32 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:32 [conn22] setShardVersion success! Mon May 9 19:09:32 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:32 [conn22] setShardVersion success! Mon May 9 19:09:32 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:32 [conn22] setShardVersion success! Mon May 9 19:09:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:32 [conn22] setShardVersion failed! Mon May 9 19:09:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:32 [conn22] setShardVersion failed! Mon May 9 19:09:32 [conn22] going to retry checkShardVersion Mon May 9 19:09:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:32 [conn22] setShardVersion failed! Mon May 9 19:09:32 [conn22] going to retry checkShardVersion Mon May 9 19:09:32 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:32 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:32 [conn22] setShardVersion failed! Mon May 9 19:09:32 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:32 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:32 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:33 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:33 [conn22] setShardVersion success! Mon May 9 19:09:33 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:33 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:33 [conn22] setShardVersion success! Mon May 9 19:09:33 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:33 [conn22] setShardVersion success! Mon May 9 19:09:33 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:33 [conn22] setShardVersion success! Mon May 9 19:09:33 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:33 [conn22] setShardVersion success! Mon May 9 19:09:33 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:33 [conn22] setShardVersion failed! Mon May 9 19:09:33 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:34 [conn22] setShardVersion failed! Mon May 9 19:09:34 [conn22] going to retry checkShardVersion Mon May 9 19:09:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:34 [conn22] setShardVersion failed! Mon May 9 19:09:34 [conn22] going to retry checkShardVersion Mon May 9 19:09:34 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:34 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:34 [conn22] setShardVersion failed! Mon May 9 19:09:34 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:34 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:34 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:35 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:35 [conn22] setShardVersion success! Mon May 9 19:09:35 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:35 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:35 [conn22] setShardVersion success! Mon May 9 19:09:35 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:35 [conn22] setShardVersion success! Mon May 9 19:09:35 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:35 [conn22] setShardVersion success! Mon May 9 19:09:35 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:35 [conn22] setShardVersion success! Mon May 9 19:09:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:35 [conn22] setShardVersion failed! Mon May 9 19:09:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:35 [conn22] setShardVersion failed! Mon May 9 19:09:35 [conn22] going to retry checkShardVersion Mon May 9 19:09:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:35 [conn22] setShardVersion failed! Mon May 9 19:09:35 [conn22] going to retry checkShardVersion Mon May 9 19:09:35 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:35 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:35 [conn22] setShardVersion failed! Mon May 9 19:09:35 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:35 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:35 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:36 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:36 [conn22] setShardVersion success! Mon May 9 19:09:36 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:36 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:36 [conn22] setShardVersion success! Mon May 9 19:09:36 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:36 [conn22] setShardVersion success! Mon May 9 19:09:36 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:36 [conn22] setShardVersion success! Mon May 9 19:09:36 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:36 [conn22] setShardVersion success! Mon May 9 19:09:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:36 [conn22] setShardVersion failed! Mon May 9 19:09:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:36 [conn22] setShardVersion failed! Mon May 9 19:09:36 [conn22] going to retry checkShardVersion Mon May 9 19:09:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:36 [conn22] setShardVersion failed! Mon May 9 19:09:36 [conn22] going to retry checkShardVersion Mon May 9 19:09:36 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:36 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:36 [conn22] setShardVersion failed! Mon May 9 19:09:36 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:36 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:36 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:37 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:37 [conn3] setShardVersion success! Mon May 9 19:09:37 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:37 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:37 [conn3] setShardVersion success! Mon May 9 19:09:37 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:37 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:37 [conn22] setShardVersion success! Mon May 9 19:09:37 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:37 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:37 [conn22] setShardVersion success! Mon May 9 19:09:37 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:37 [conn22] setShardVersion success! Mon May 9 19:09:37 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:37 [conn22] setShardVersion success! Mon May 9 19:09:37 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:37 [conn22] setShardVersion success! Mon May 9 19:09:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:37 [conn22] setShardVersion failed! Mon May 9 19:09:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:37 [conn22] setShardVersion failed! Mon May 9 19:09:37 [conn22] going to retry checkShardVersion Mon May 9 19:09:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:37 [conn22] setShardVersion failed! Mon May 9 19:09:37 [conn22] going to retry checkShardVersion Mon May 9 19:09:37 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:37 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:37 [conn22] setShardVersion failed! Mon May 9 19:09:37 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:37 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:37 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:37 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:37 [conn3] setShardVersion success! Mon May 9 19:09:37 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:09:38 [LockPinger] dist_lock pinged successfully for: appserver11:1304719091:1804289383 Mon May 9 19:09:38 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:38 [conn3] setShardVersion success! Mon May 9 19:09:38 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:38 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:38 [conn22] setShardVersion success! Mon May 9 19:09:38 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:38 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:38 [conn22] setShardVersion success! Mon May 9 19:09:38 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:38 [conn22] setShardVersion success! Mon May 9 19:09:38 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:38 [conn22] setShardVersion success! Mon May 9 19:09:38 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:38 [conn22] setShardVersion success! Mon May 9 19:09:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:38 [conn22] setShardVersion failed! Mon May 9 19:09:38 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:38 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:38 [conn22] setShardVersion failed! Mon May 9 19:09:38 [conn22] going to retry checkShardVersion Mon May 9 19:09:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:39 [conn22] setShardVersion failed! Mon May 9 19:09:39 [conn22] going to retry checkShardVersion Mon May 9 19:09:39 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:39 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:39 [conn22] setShardVersion failed! Mon May 9 19:09:39 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:39 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:39 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:40 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:40 [conn22] setShardVersion success! Mon May 9 19:09:40 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:40 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:40 [conn22] setShardVersion success! Mon May 9 19:09:40 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:40 [conn22] setShardVersion success! Mon May 9 19:09:40 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:40 [conn22] setShardVersion success! Mon May 9 19:09:40 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:40 [conn22] setShardVersion success! Mon May 9 19:09:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:40 [conn22] setShardVersion failed! Mon May 9 19:09:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:40 [conn22] setShardVersion failed! Mon May 9 19:09:40 [conn22] going to retry checkShardVersion Mon May 9 19:09:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:40 [conn22] setShardVersion failed! Mon May 9 19:09:40 [conn22] going to retry checkShardVersion Mon May 9 19:09:40 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:40 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:40 [conn22] setShardVersion failed! Mon May 9 19:09:40 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:40 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:40 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:41 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:41 [conn22] setShardVersion success! Mon May 9 19:09:41 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:41 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:41 [conn22] setShardVersion success! Mon May 9 19:09:41 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:41 [conn22] setShardVersion success! Mon May 9 19:09:41 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:41 [conn22] setShardVersion success! Mon May 9 19:09:41 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:41 [conn22] setShardVersion success! Mon May 9 19:09:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:41 [conn22] setShardVersion failed! Mon May 9 19:09:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:41 [conn22] setShardVersion failed! Mon May 9 19:09:41 [conn22] going to retry checkShardVersion Mon May 9 19:09:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:41 [conn22] setShardVersion failed! Mon May 9 19:09:41 [conn22] going to retry checkShardVersion Mon May 9 19:09:41 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:41 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:41 [conn22] setShardVersion failed! Mon May 9 19:09:41 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:41 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:41 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:42 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:42 [conn3] setShardVersion success! Mon May 9 19:09:42 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "hal_livingSocial_DFA03", bucketId: "groups", variationId: "_default" } Mon May 9 19:09:42 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:42 [conn22] setShardVersion success! Mon May 9 19:09:42 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:42 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:42 [conn22] setShardVersion success! Mon May 9 19:09:42 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:42 [conn22] setShardVersion success! Mon May 9 19:09:42 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:42 [conn22] setShardVersion success! Mon May 9 19:09:42 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:42 [conn22] setShardVersion success! Mon May 9 19:09:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:42 [conn22] setShardVersion failed! Mon May 9 19:09:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:42 [conn22] setShardVersion failed! Mon May 9 19:09:42 [conn22] going to retry checkShardVersion Mon May 9 19:09:42 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:42 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:42 [conn22] setShardVersion failed! Mon May 9 19:09:42 [conn22] going to retry checkShardVersion Mon May 9 19:09:43 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:43 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:43 [conn22] setShardVersion failed! Mon May 9 19:09:43 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:43 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:43 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb10.example.com:27018 { setName: "4", ismaster: true, secondary: false, hosts: [ "mongodb10.example.com:27018", "mongodb11.example.com:27018" ], arbiters: [ "mongodb12.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb01.example.com:27018 { setName: "1", ismaster: true, secondary: false, hosts: [ "mongodb01.example.com:27018", "mongodb02.example.com:27018" ], arbiters: [ "mongodb03.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb05.example.com:27018 { setName: "2", ismaster: true, secondary: false, hosts: [ "mongodb05.example.com:27018", "mongodb04.example.com:27018" ], arbiters: [ "mongodb06.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:43 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: mongodb07.example.com:27018 { setName: "3", ismaster: true, secondary: false, hosts: [ "mongodb07.example.com:27018", "mongodb08.example.com:27018" ], arbiters: [ "mongodb09.example.com:27018" ], maxBsonObjectSize: 16777216, ok: 1.0 } Mon May 9 19:09:44 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:44 [conn22] setShardVersion success! Mon May 9 19:09:44 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:44 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:44 [conn22] setShardVersion success! Mon May 9 19:09:44 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:44 [conn22] setShardVersion success! Mon May 9 19:09:44 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:44 [conn22] setShardVersion success! Mon May 9 19:09:44 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:44 [conn22] setShardVersion success! Mon May 9 19:09:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:44 [conn22] setShardVersion failed! Mon May 9 19:09:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:44 [conn22] setShardVersion failed! Mon May 9 19:09:44 [conn22] going to retry checkShardVersion Mon May 9 19:09:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:44 [conn22] setShardVersion failed! Mon May 9 19:09:44 [conn22] going to retry checkShardVersion Mon May 9 19:09:44 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:44 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:44 [conn22] setShardVersion failed! Mon May 9 19:09:44 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:44 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:44 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:44 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:44 [conn3] setShardVersion success! Mon May 9 19:09:44 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:45 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:45 [conn22] setShardVersion success! Mon May 9 19:09:45 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:45 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:47 [conn22] setShardVersion success! Mon May 9 19:09:47 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:47 [conn22] setShardVersion success! Mon May 9 19:09:47 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:47 [conn22] setShardVersion success! Mon May 9 19:09:47 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:47 [conn22] setShardVersion success! Mon May 9 19:09:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:47 [conn22] setShardVersion failed! Mon May 9 19:09:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:47 [conn22] setShardVersion failed! Mon May 9 19:09:47 [conn22] going to retry checkShardVersion Mon May 9 19:09:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:47 [conn22] setShardVersion failed! Mon May 9 19:09:47 [conn22] going to retry checkShardVersion Mon May 9 19:09:47 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:47 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:47 [conn22] setShardVersion failed! Mon May 9 19:09:47 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:47 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:47 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:47 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:47 [conn3] setShardVersion success! Mon May 9 19:09:47 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:47 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:47 [conn3] setShardVersion success! Mon May 9 19:09:47 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:48 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:48 [conn22] setShardVersion success! Mon May 9 19:09:48 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:48 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:48 [conn22] setShardVersion success! Mon May 9 19:09:48 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:48 [conn22] setShardVersion success! Mon May 9 19:09:48 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:48 [conn22] setShardVersion success! Mon May 9 19:09:48 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:48 [conn22] setShardVersion success! Mon May 9 19:09:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:48 [conn22] setShardVersion failed! Mon May 9 19:09:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:48 [conn22] setShardVersion failed! Mon May 9 19:09:48 [conn22] going to retry checkShardVersion Mon May 9 19:09:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:48 [conn22] setShardVersion failed! Mon May 9 19:09:48 [conn22] going to retry checkShardVersion Mon May 9 19:09:48 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:48 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:48 [conn22] setShardVersion failed! Mon May 9 19:09:48 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:48 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:48 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:49 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:49 [conn22] setShardVersion success! Mon May 9 19:09:49 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:49 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:49 [conn22] setShardVersion success! Mon May 9 19:09:49 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:49 [conn22] setShardVersion success! Mon May 9 19:09:49 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:49 [conn22] setShardVersion success! Mon May 9 19:09:49 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:49 [conn22] setShardVersion success! Mon May 9 19:09:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:49 [conn22] setShardVersion failed! Mon May 9 19:09:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:49 [conn22] setShardVersion failed! Mon May 9 19:09:49 [conn22] going to retry checkShardVersion Mon May 9 19:09:49 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:49 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:49 [conn22] setShardVersion failed! Mon May 9 19:09:49 [conn22] going to retry checkShardVersion Mon May 9 19:09:50 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:50 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:50 [conn22] setShardVersion failed! Mon May 9 19:09:50 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:50 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:50 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:51 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:51 [conn3] setShardVersion success! Mon May 9 19:09:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:51 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:51 [conn3] setShardVersion success! Mon May 9 19:09:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:51 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:51 [conn22] setShardVersion success! Mon May 9 19:09:51 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:51 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:51 [conn22] setShardVersion success! Mon May 9 19:09:51 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:51 [conn22] setShardVersion success! Mon May 9 19:09:51 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:51 [conn22] setShardVersion success! Mon May 9 19:09:51 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:51 [conn22] setShardVersion success! Mon May 9 19:09:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:51 [conn22] setShardVersion failed! Mon May 9 19:09:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:51 [conn22] setShardVersion failed! Mon May 9 19:09:51 [conn22] going to retry checkShardVersion Mon May 9 19:09:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:51 [conn22] setShardVersion failed! Mon May 9 19:09:51 [conn22] going to retry checkShardVersion Mon May 9 19:09:51 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:51 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:51 [conn22] setShardVersion failed! Mon May 9 19:09:51 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:51 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:51 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:51 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:51 [conn3] setShardVersion success! Mon May 9 19:09:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:09:51 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:51 [conn3] setShardVersion success! Mon May 9 19:09:51 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:52 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:52 [conn22] setShardVersion success! Mon May 9 19:09:52 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:52 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:52 [conn22] setShardVersion success! Mon May 9 19:09:52 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:52 [conn22] setShardVersion success! Mon May 9 19:09:52 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:52 [conn22] setShardVersion success! Mon May 9 19:09:52 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:52 [conn22] setShardVersion success! Mon May 9 19:09:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:52 [conn22] setShardVersion failed! Mon May 9 19:09:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:52 [conn22] setShardVersion failed! Mon May 9 19:09:52 [conn22] going to retry checkShardVersion Mon May 9 19:09:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:52 [conn22] setShardVersion failed! Mon May 9 19:09:52 [conn22] going to retry checkShardVersion Mon May 9 19:09:52 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:52 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:52 [conn22] setShardVersion failed! Mon May 9 19:09:52 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:52 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:52 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:52 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:52 [conn3] setShardVersion success! Mon May 9 19:09:52 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "campaigns", variationId: "_default" } Mon May 9 19:09:52 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:52 [conn3] setShardVersion success! Mon May 9 19:09:52 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslandsHub", bucketId: "ads", variationId: "_default" } Mon May 9 19:09:53 [Balancer] skipping balancing round because balancing is disabled Mon May 9 19:09:53 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:53 [conn22] setShardVersion success! Mon May 9 19:09:53 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:53 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:53 [conn22] setShardVersion success! Mon May 9 19:09:53 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:53 [conn22] setShardVersion success! Mon May 9 19:09:53 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:53 [conn22] setShardVersion success! Mon May 9 19:09:53 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:53 [conn22] setShardVersion success! Mon May 9 19:09:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:53 [conn22] setShardVersion failed! Mon May 9 19:09:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:53 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:53 [conn22] setShardVersion failed! Mon May 9 19:09:53 [conn22] going to retry checkShardVersion Mon May 9 19:09:53 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] going to retry checkShardVersion Mon May 9 19:09:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:54 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:54 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:54 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:54 [conn22] setShardVersion success! Mon May 9 19:09:54 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:54 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:54 [conn22] setShardVersion success! Mon May 9 19:09:54 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:54 [conn22] setShardVersion success! Mon May 9 19:09:54 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:54 [conn22] setShardVersion success! Mon May 9 19:09:54 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:54 [conn22] setShardVersion success! Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] going to retry checkShardVersion Mon May 9 19:09:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] going to retry checkShardVersion Mon May 9 19:09:54 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:54 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:54 [conn22] setShardVersion failed! Mon May 9 19:09:54 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:54 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:54 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:55 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:55 [conn22] setShardVersion success! Mon May 9 19:09:55 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:55 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:55 [conn22] setShardVersion success! Mon May 9 19:09:55 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:55 [conn22] setShardVersion success! Mon May 9 19:09:55 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:55 [conn22] setShardVersion success! Mon May 9 19:09:55 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:55 [conn22] setShardVersion success! Mon May 9 19:09:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:55 [conn22] setShardVersion failed! Mon May 9 19:09:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:55 [conn22] setShardVersion failed! Mon May 9 19:09:55 [conn22] going to retry checkShardVersion Mon May 9 19:09:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:55 [conn22] setShardVersion failed! Mon May 9 19:09:55 [conn22] going to retry checkShardVersion Mon May 9 19:09:55 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:55 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:55 [conn22] setShardVersion failed! Mon May 9 19:09:55 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:55 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:55 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:56 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:56 [conn22] setShardVersion success! Mon May 9 19:09:56 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:56 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:56 [conn22] setShardVersion success! Mon May 9 19:09:56 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:56 [conn22] setShardVersion success! Mon May 9 19:09:56 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:56 [conn22] setShardVersion success! Mon May 9 19:09:56 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:56 [conn22] setShardVersion success! Mon May 9 19:09:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:56 [conn22] setShardVersion failed! Mon May 9 19:09:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:56 [conn22] setShardVersion failed! Mon May 9 19:09:56 [conn22] going to retry checkShardVersion Mon May 9 19:09:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:56 [conn22] setShardVersion failed! Mon May 9 19:09:56 [conn22] going to retry checkShardVersion Mon May 9 19:09:56 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:56 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:56 [conn22] setShardVersion failed! Mon May 9 19:09:56 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:56 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:56 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:57 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:57 [conn3] setShardVersion success! Mon May 9 19:09:57 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:57 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:57 [conn3] setShardVersion success! Mon May 9 19:09:57 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:57 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:57 [conn22] setShardVersion success! Mon May 9 19:09:57 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:57 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:57 [conn22] setShardVersion success! Mon May 9 19:09:57 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:57 [conn22] setShardVersion success! Mon May 9 19:09:57 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:57 [conn22] setShardVersion success! Mon May 9 19:09:57 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:57 [conn22] setShardVersion success! Mon May 9 19:09:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:57 [conn22] setShardVersion failed! Mon May 9 19:09:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:57 [conn22] setShardVersion failed! Mon May 9 19:09:57 [conn22] going to retry checkShardVersion Mon May 9 19:09:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:57 [conn22] setShardVersion failed! Mon May 9 19:09:57 [conn22] going to retry checkShardVersion Mon May 9 19:09:57 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:57 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:57 [conn22] setShardVersion failed! Mon May 9 19:09:57 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:57 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:57 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:58 [conn3] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 82000|3, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x7fbf94002400 Mon May 9 19:09:58 [conn3] setShardVersion success! Mon May 9 19:09:58 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "virginIslands", bucketId: "advertisers", variationId: "_default" } Mon May 9 19:09:58 [conn3] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.stats { setShardVersion: "example.stats", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 80000|1, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0007400 Mon May 9 19:09:58 [conn3] setShardVersion success! Mon May 9 19:09:58 [conn3] update failed b/c of StaleConfigException, retrying left:4 ns: example.stats query: { entityId: "knot", bucketId: "publishers", variationId: "_default" } Mon May 9 19:09:58 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:09:58 [conn22] setShardVersion success! Mon May 9 19:09:58 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:09:58 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:09:59 [conn22] setShardVersion success! Mon May 9 19:09:59 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:09:59 [conn22] setShardVersion success! Mon May 9 19:09:59 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:09:59 [conn22] setShardVersion success! Mon May 9 19:09:59 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:09:59 [conn22] setShardVersion success! Mon May 9 19:09:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:59 [conn22] setShardVersion failed! Mon May 9 19:09:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:59 [conn22] setShardVersion failed! Mon May 9 19:09:59 [conn22] going to retry checkShardVersion Mon May 9 19:09:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:59 [conn22] setShardVersion failed! Mon May 9 19:09:59 [conn22] going to retry checkShardVersion Mon May 9 19:09:59 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "2" } Mon May 9 19:09:59 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), authoritative: true, shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:09:59 [conn22] setShardVersion failed! Mon May 9 19:09:59 [conn22] setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:59 [conn22] Assertion: 10429:setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:09:59 [conn22] AssertionException in process: setShardVersion failed host[mongodb04.example.com:27018] { errmsg: "not master", ok: 0.0 } Mon May 9 19:10:00 [conn22] setShardVersion 2 2/mongodb05.example.com:27018,mongodb04.example.com:27018,mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x1375810 Mon May 9 19:10:00 [conn22] setShardVersion success! Mon May 9 19:10:00 [conn22] ns: example.userfile ClusteredCursor::query ShardConnection had to change attempt: 0 Mon May 9 19:10:00 [conn22] setShardVersion 1 1/mongodb01.example.com:27018,mongodb02.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x13ffd30 Mon May 9 19:10:00 [conn22] setShardVersion success! Mon May 9 19:10:00 [conn22] setShardVersion 3 3/mongodb07.example.com:27018,mongodb08.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "3", shardHost: "3/mongodb07.example.com:27018,mongodb08.example.com:27018" } 0x136b6c0 Mon May 9 19:10:00 [conn22] setShardVersion success! Mon May 9 19:10:00 [conn22] setShardVersion 4 4/mongodb10.example.com:27018,mongodb11.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "4", shardHost: "4/mongodb10.example.com:27018,mongodb11.example.com:27018" } 0x13fdb90 Mon May 9 19:10:00 [conn22] setShardVersion success! Mon May 9 19:10:00 [conn22] setShardVersion 1 mongodb01.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 0|0, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "1", shardHost: "1/mongodb01.example.com:27018,mongodb02.example.com:27018" } 0x7fbfa000bf90 Mon May 9 19:10:00 [conn22] setShardVersion success! Mon May 9 19:10:00 [conn22] setShardVersion 2 mongodb04.example.com:27018 example.userfile { setShardVersion: "example.userfile", configdb: "mongodb-config03.example.com:27019,mongodb-config02.example.co...", version: Timestamp 8000|9, serverID: ObjectId('4dc46ef31dc02d61ad0bcce3'), shard: "2", shardHost: "2/mongodb05.example.com:27018,mongodb04.example.com:27018" } 0x7fbfa0002750 Mon May 9 19:10:00 [conn22] setShardVersion failed! Mon May 9 19:10:00 [conn22] DBConfig unserialize: example { _id: "example", partitioned: true, primary: "