2012-08-09 08:17:01 EDT | Thu Aug 9 08:17:01 [conn29] info DFM::findAll(): extent 0:2baa000 was empty, skipping ahead. ns:test.jstests_remove9 |
| Thu Aug 9 08:17:01 [conn29] info DFM::findAll(): extent 0:2baa000 was empty, skipping ahead. ns:test.jstests_remove9 |
| Thu Aug 9 08:17:01 [conn30] remove test.jstests_remove9 query: { i: { $gte: 0.0 } } keyUpdates:0 numYields: 16 locks(micros) w:314160 285ms |
| Thu Aug 9 08:17:01 [initandlisten] connection accepted from 127.0.0.1:47255 #31 (3 connections now open) |
| Thu Aug 9 08:17:01 [conn31] end connection 127.0.0.1:47255 (2 connections now open) |
| Thu Aug 9 08:17:02 [conn30] remove test.jstests_remove9 query: { i: { $gte: 0.0 } } keyUpdates:0 numYields: 1 locks(micros) w:159204 129ms |
| Thu Aug 9 08:17:02 [conn29] end connection 127.0.0.1:47167 (1 connection now open) |
| Thu Aug 9 08:17:02 [conn30] remove test.jstests_remove9 query: { i: { $gte: 0.0 } } keyUpdates:0 numYields: 1 locks(micros) w:181093 133ms |
| Thu Aug 9 08:17:02 [conn30] end connection 127.0.0.1:47168 (0 connections now open) |
| Thu Aug 9 08:17:02 [initandlisten] connection accepted from 127.0.0.1:47262 #32 (1 connection now open) |
| Thu Aug 9 08:17:02 [conn32] end connection 127.0.0.1:47262 (0 connections now open) |
| MongoDB shell version: 2.2.0-rc1-pre- |
| connecting to: 127.0.0.1:27999/test |
| Thu Aug 9 08:17:03 [initandlisten] connection accepted from 127.0.0.1:47267 #33 (1 connection now open) |
| null |
| ReplSetTest Starting Set |
| ReplSetTest n is : 0 |
| ReplSetTest n: 0 ports: [ 31100, 31101, 31102 ] 31100 number |
| Replica set test! |
| "useHostName" : true, |
| "oplogSize" : 40, |
| "keyFile" : undefined, |
| "port" : 31100, |
| "noprealloc" : "", |
| "smallfiles" : "", |
| "rest" : "", |
| "replSet" : "replReads-rs0", |
| "dbpath" : "$set-$node", |
| { |
| "noJournalPrealloc" : undefined, |
| "pathOpts" : { |
| "testName" : "replReads", |
| "shard" : 0, |
| "node" : 0, |
| "set" : "replReads-rs0" |
| "useHostname" : true, |
| "restart" : undefined |
| }, |
| ReplSetTest Starting.... |
| Resetting db path '/data/db/replReads-rs0-0' |
| } |
| Thu Aug 9 08:17:03 shell: started program /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/mongod --oplogSize 40 --port 31100 --noprealloc --smallfiles --rest --replSet replReads-rs0 --dbpath /data/db/replReads-rs0-0 |
| m31100| note: noprealloc may hurt performance in many applications |
| m31100| Thu Aug 9 08:17:03 [initandlisten] MongoDB starting : pid=766 port=31100 dbpath=/data/db/replReads-rs0-0 64-bit host=bs-rhel-57-64-2 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] build info: Linux bs-rhel-57-64-2 2.6.18-274.el5xen #1 SMP Fri Jul 8 17:45:44 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] journal dir=/data/db/replReads-rs0-0/journal |
| m31100| Thu Aug 9 08:17:03 [initandlisten] options: { dbpath: "/data/db/replReads-rs0-0", noprealloc: true, oplogSize: 40, port: 31100, replSet: "replReads-rs0", rest: true, smallfiles: true } |
| m31100| Thu Aug 9 08:17:03 [initandlisten] preallocateIsFaster=true 2.02 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] recover : no journal files present, no recovery needed |
| m31100| Thu Aug 9 08:17:03 [initandlisten] waiting for connections on port 31100 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] connection accepted from 10.76.211.188:45651 #1 (1 connection now open) |
| m31100| Thu Aug 9 08:17:03 [websvr] admin web console waiting for connections on port 32100 |
| m31100| Thu Aug 9 08:17:03 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) |
| m31100| Thu Aug 9 08:17:03 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done |
| ReplSetTest n is : 1 |
| ReplSetTest n: 1 ports: [ 31100, 31101, 31102 ] 31101 number |
| [ connection to bs-rhel-57-64-2:31100 ] |
| "useHostName" : true, |
| "oplogSize" : 40, |
| "keyFile" : undefined, |
| "port" : 31101, |
| "noprealloc" : "", |
| "smallfiles" : "", |
| "rest" : "", |
| "replSet" : "replReads-rs0", |
| { |
| "dbpath" : "$set-$node", |
| "noJournalPrealloc" : undefined, |
| "pathOpts" : { |
| "testName" : "replReads", |
| "shard" : 0, |
| "node" : 1, |
| "set" : "replReads-rs0" |
| "useHostname" : true, |
| "restart" : undefined |
| }, |
| ReplSetTest Starting.... |
| Resetting db path '/data/db/replReads-rs0-1' |
| } |
| Thu Aug 9 08:17:03 shell: started program /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/mongod --oplogSize 40 --port 31101 --noprealloc --smallfiles --rest --replSet replReads-rs0 --dbpath /data/db/replReads-rs0-1 |
| m31100| Thu Aug 9 08:17:03 [initandlisten] connection accepted from 127.0.0.1:39222 #2 (2 connections now open) |
| m31101| note: noprealloc may hurt performance in many applications |
| m31101| Thu Aug 9 08:17:03 [initandlisten] MongoDB starting : pid=818 port=31101 dbpath=/data/db/replReads-rs0-1 64-bit host=bs-rhel-57-64-2 |
| m31101| Thu Aug 9 08:17:03 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5 |
| m31101| Thu Aug 9 08:17:03 [initandlisten] build info: Linux bs-rhel-57-64-2 2.6.18-274.el5xen #1 SMP Fri Jul 8 17:45:44 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49 |
| m31101| Thu Aug 9 08:17:03 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126 |
| m31101| Thu Aug 9 08:17:03 [initandlisten] journal dir=/data/db/replReads-rs0-1/journal |
| m31101| Thu Aug 9 08:17:03 [initandlisten] options: { dbpath: "/data/db/replReads-rs0-1", noprealloc: true, oplogSize: 40, port: 31101, replSet: "replReads-rs0", rest: true, smallfiles: true } |
| m31101| Thu Aug 9 08:17:03 [initandlisten] recover : no journal files present, no recovery needed |
| m31101| Thu Aug 9 08:17:04 [initandlisten] preallocateIsFaster=true 2.04 |
| m31101| Thu Aug 9 08:17:04 [initandlisten] waiting for connections on port 31101 |
| m31101| Thu Aug 9 08:17:04 [initandlisten] connection accepted from 10.76.211.188:36530 #1 (1 connection now open) |
| m31101| Thu Aug 9 08:17:04 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) |
| m31101| Thu Aug 9 08:17:04 [websvr] admin web console waiting for connections on port 32101 |
| m31101| Thu Aug 9 08:17:04 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done |
| ReplSetTest n is : 2 |
| ReplSetTest n: 2 ports: [ 31100, 31101, 31102 ] 31102 number |
| [ connection to bs-rhel-57-64-2:31100, connection to bs-rhel-57-64-2:31101 ] |
| "useHostName" : true, |
| "oplogSize" : 40, |
| "keyFile" : undefined, |
| "port" : 31102, |
| "noprealloc" : "", |
| "smallfiles" : "", |
| "rest" : "", |
| { |
| "dbpath" : "$set-$node", |
| "replSet" : "replReads-rs0", |
| "noJournalPrealloc" : undefined, |
| "pathOpts" : { |
| "testName" : "replReads", |
| "shard" : 0, |
| "node" : 2, |
| "set" : "replReads-rs0" |
| "useHostname" : true, |
| "restart" : undefined |
| }, |
| ReplSetTest Starting.... |
| Resetting db path '/data/db/replReads-rs0-2' |
| } |
| Thu Aug 9 08:17:04 shell: started program /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/mongod --oplogSize 40 --port 31102 --noprealloc --smallfiles --rest --replSet replReads-rs0 --dbpath /data/db/replReads-rs0-2 |
| m31101| Thu Aug 9 08:17:04 [initandlisten] connection accepted from 127.0.0.1:46784 #2 (2 connections now open) |
| m31102| Thu Aug 9 08:17:04 [initandlisten] MongoDB starting : pid=871 port=31102 dbpath=/data/db/replReads-rs0-2 64-bit host=bs-rhel-57-64-2 |
| m31102| Thu Aug 9 08:17:04 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5 |
| m31102| note: noprealloc may hurt performance in many applications |
| m31102| Thu Aug 9 08:17:04 [initandlisten] build info: Linux bs-rhel-57-64-2 2.6.18-274.el5xen #1 SMP Fri Jul 8 17:45:44 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49 |
| m31102| Thu Aug 9 08:17:04 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126 |
| m31102| Thu Aug 9 08:17:04 [initandlisten] options: { dbpath: "/data/db/replReads-rs0-2", noprealloc: true, oplogSize: 40, port: 31102, replSet: "replReads-rs0", rest: true, smallfiles: true } |
| m31102| Thu Aug 9 08:17:04 [initandlisten] journal dir=/data/db/replReads-rs0-2/journal |
2012-08-09 08:17:15 EDT | m31102| Thu Aug 9 08:17:04 [initandlisten] recover : no journal files present, no recovery needed |
| m31102| Thu Aug 9 08:17:04 [initandlisten] preallocateIsFaster=true 2.3 |
| m31102| Thu Aug 9 08:17:04 [initandlisten] preallocateIsFaster=true 2.36 |
| m31102| Thu Aug 9 08:17:06 [initandlisten] preallocateIsFaster=true 2.1 |
| m31102| Thu Aug 9 08:17:06 [initandlisten] preallocating a journal file /data/db/replReads-rs0-2/journal/prealloc.0 |
| m31102| Thu Aug 9 08:17:09 [initandlisten] preallocating a journal file /data/db/replReads-rs0-2/journal/prealloc.1 |
| m31100| Thu Aug 9 08:17:13 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) |
| m31101| Thu Aug 9 08:17:14 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) |
| m31102| Thu Aug 9 08:17:12 [initandlisten] preallocating a journal file /data/db/replReads-rs0-2/journal/prealloc.2 |
| m31102| Thu Aug 9 08:17:15 [initandlisten] waiting for connections on port 31102 |
| m31102| Thu Aug 9 08:17:15 [initandlisten] connection accepted from 10.76.211.188:47625 #1 (1 connection now open) |
| m31102| Thu Aug 9 08:17:15 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) |
| m31102| Thu Aug 9 08:17:15 [websvr] admin web console waiting for connections on port 32102 |
| m31102| Thu Aug 9 08:17:15 [initandlisten] connection accepted from 127.0.0.1:41293 #2 (2 connections now open) |
| m31102| Thu Aug 9 08:17:15 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done |
| connection to bs-rhel-57-64-2:31100, |
| connection to bs-rhel-57-64-2:31101, |
| connection to bs-rhel-57-64-2:31102 |
| [ |
| ] |
| "replSetInitiate" : { |
| "_id" : "replReads-rs0", |
| "members" : [ |
| { |
| "_id" : 0, |
| "host" : "bs-rhel-57-64-2:31100" |
| }, |
| { |
| "_id" : 1, |
| "host" : "bs-rhel-57-64-2:31101" |
| }, |
| { |
| "_id" : 2, |
| "host" : "bs-rhel-57-64-2:31102" |
| { |
| } |
| ] |
| } |
| m31100| Thu Aug 9 08:17:15 [conn2] replSet replSetInitiate admin command received from client |
| m31100| Thu Aug 9 08:17:15 [conn2] replSet replSetInitiate config object parses ok, 3 members specified |
| m31101| Thu Aug 9 08:17:15 [initandlisten] connection accepted from 10.76.211.188:36588 #3 (3 connections now open) |
| m31102| Thu Aug 9 08:17:15 [initandlisten] connection accepted from 10.76.211.188:47630 #3 (3 connections now open) |
| } |
| m31100| Thu Aug 9 08:17:15 [conn2] ****** |
| m31100| Thu Aug 9 08:17:15 [conn2] creating replication oplog of size: 40MB... |
| m31100| Thu Aug 9 08:17:15 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/local.ns, filling with zeroes... |
| m31100| Thu Aug 9 08:17:15 [FileAllocator] creating directory /data/db/replReads-rs0-0/_tmp |
| m31100| Thu Aug 9 08:17:15 [conn2] replSet replSetInitiate all members seem up |
| m31100| Thu Aug 9 08:17:15 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/local.ns, size: 16MB, took 0.027 secs |
2012-08-09 08:17:17 EDT | m31100| Thu Aug 9 08:17:15 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/local.0, filling with zeroes... |
| m31100| Thu Aug 9 08:17:15 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/local.0, size: 64MB, took 0.162 secs |
| m31100| Thu Aug 9 08:17:17 [conn2] ****** |
| m31100| Thu Aug 9 08:17:17 [conn2] replSet info saving a newer config version to local.system.replset |
| m31100| Thu Aug 9 08:17:17 [conn2] replSet replSetInitiate config now saved locally. Should come online in about a minute. |
| m31100| Thu Aug 9 08:17:17 [conn2] replSet saveConfigLocally done |
| m31100| Thu Aug 9 08:17:17 [conn2] command admin.$cmd command: { replSetInitiate: { _id: "replReads-rs0", members: [ { _id: 0.0, host: "bs-rhel-57-64-2:31100" }, { _id: 1.0, host: "bs-rhel-57-64-2:31101" }, { _id: 2.0, host: "bs-rhel-57-64-2:31102" } ] } } ntoreturn:1 keyUpdates:0 locks(micros) W:1922858 reslen:112 1924ms |
| "info" : "Config now saved locally. Should come online in about a minute.", |
| "ok" : 1 |
| { |
| } |
2012-08-09 08:17:24 EDT | m31100| Thu Aug 9 08:17:23 [rsStart] replSet I am bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:17:23 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is up |
| m31100| Thu Aug 9 08:17:23 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is up |
| m31100| Thu Aug 9 08:17:23 [rsStart] replSet STARTUP2 |
| m31100| Thu Aug 9 08:17:24 [initandlisten] connection accepted from 10.76.211.188:45717 #3 (3 connections now open) |
| m31101| Thu Aug 9 08:17:24 [rsStart] replSet I am bs-rhel-57-64-2:31101 |
| m31101| Thu Aug 9 08:17:24 [rsStart] replSet got config version 1 from a remote, saving locally |
| m31101| Thu Aug 9 08:17:24 [rsStart] replSet info saving a newer config version to local.system.replset |
| m31101| Thu Aug 9 08:17:24 [rsStart] trying to contact bs-rhel-57-64-2:31100 |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/local.ns, filling with zeroes... |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] creating directory /data/db/replReads-rs0-1/_tmp |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/local.0, filling with zeroes... |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/local.0, size: 16MB, took 0.028 secs |
| m31100| Thu Aug 9 08:17:24 [rsSync] replSet SECONDARY |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/local.ns, size: 16MB, took 0.027 secs |
| m31101| Thu Aug 9 08:17:24 [rsStart] replSet saveConfigLocally done |
| m31101| Thu Aug 9 08:17:24 [rsStart] replSet STARTUP2 |
| m31101| Thu Aug 9 08:17:24 [rsSync] ****** |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/local.1, filling with zeroes... |
| m31101| Thu Aug 9 08:17:24 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/local.1, size: 64MB, took 0.112 secs |
| m31101| Thu Aug 9 08:17:24 [rsSync] creating replication oplog of size: 40MB... |
| m31102| Thu Aug 9 08:17:25 [rsStart] trying to contact bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:17:25 [initandlisten] connection accepted from 10.76.211.188:45720 #4 (4 connections now open) |
| m31102| Thu Aug 9 08:17:25 [rsStart] replSet I am bs-rhel-57-64-2:31102 |
| m31102| Thu Aug 9 08:17:25 [rsStart] replSet got config version 1 from a remote, saving locally |
| m31102| Thu Aug 9 08:17:25 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/local.ns, filling with zeroes... |
| m31102| Thu Aug 9 08:17:25 [FileAllocator] creating directory /data/db/replReads-rs0-2/_tmp |
| m31102| Thu Aug 9 08:17:25 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/local.ns, size: 16MB, took 0.192 secs |
| m31102| Thu Aug 9 08:17:25 [rsStart] replSet info saving a newer config version to local.system.replset |
| m31100| Thu Aug 9 08:17:25 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state STARTUP2 |
| m31102| Thu Aug 9 08:17:25 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/local.0, filling with zeroes... |
2012-08-09 08:17:26 EDT | m31100| Thu Aug 9 08:17:25 [rsMgr] not electing self, bs-rhel-57-64-2:31101 would veto |
| m31101| Thu Aug 9 08:17:26 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is up |
| m31101| Thu Aug 9 08:17:26 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state SECONDARY |
| m31102| Thu Aug 9 08:17:25 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/local.0, size: 16MB, took 0.153 secs |
| m31101| Thu Aug 9 08:17:26 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is up |
| m31102| Thu Aug 9 08:17:26 [initandlisten] connection accepted from 10.76.211.188:47635 #4 (4 connections now open) |
| m31102| Thu Aug 9 08:17:26 [rsStart] replSet STARTUP2 |
| m31102| Thu Aug 9 08:17:26 [rsStart] replSet saveConfigLocally done |
| m31102| Thu Aug 9 08:17:26 [rsSync] ****** |
| m31101| Thu Aug 9 08:17:26 [rsSync] ****** |
| m31101| Thu Aug 9 08:17:26 [rsSync] replSet initial sync pending |
| m31102| Thu Aug 9 08:17:26 [rsSync] creating replication oplog of size: 40MB... |
2012-08-09 08:17:28 EDT | m31101| Thu Aug 9 08:17:26 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync |
| m31102| Thu Aug 9 08:17:26 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/local.1, filling with zeroes... |
| m31102| Thu Aug 9 08:17:27 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/local.1, size: 64MB, took 0.165 secs |
| m31102| Thu Aug 9 08:17:27 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state SECONDARY |
| m31102| Thu Aug 9 08:17:27 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is up |
| m31101| Thu Aug 9 08:17:27 [initandlisten] connection accepted from 10.76.211.188:36598 #4 (4 connections now open) |
| m31102| Thu Aug 9 08:17:27 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state STARTUP2 |
| m31100| Thu Aug 9 08:17:27 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state STARTUP2 |
| m31100| Thu Aug 9 08:17:27 [rsMgr] not electing self, bs-rhel-57-64-2:31102 would veto |
| m31102| Thu Aug 9 08:17:27 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is up |
2012-08-09 08:17:34 EDT | m31101| Thu Aug 9 08:17:28 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state STARTUP2 |
| m31102| Thu Aug 9 08:17:28 [rsSync] ****** |
| m31102| Thu Aug 9 08:17:28 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync |
| m31100| Thu Aug 9 08:17:33 [rsMgr] replSet info electSelf 0 |
| m31102| Thu Aug 9 08:17:28 [rsSync] replSet initial sync pending |
| m31102| Thu Aug 9 08:17:33 [conn3] replSet RECOVERING |
| m31101| Thu Aug 9 08:17:33 [conn3] replSet RECOVERING |
| m31101| Thu Aug 9 08:17:33 [conn3] replSet info voting yea for bs-rhel-57-64-2:31100 (0) |
| m31100| Thu Aug 9 08:17:33 [rsMgr] replSet PRIMARY |
| m31100| Thu Aug 9 08:17:33 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state RECOVERING |
| m31101| Thu Aug 9 08:17:34 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state RECOVERING |
| m31102| Thu Aug 9 08:17:33 [conn3] replSet info voting yea for bs-rhel-57-64-2:31100 (0) |
| m31100| Thu Aug 9 08:17:35 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/admin.ns, filling with zeroes... |
| m31101| Thu Aug 9 08:17:34 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state PRIMARY |
| m31100| Thu Aug 9 08:17:35 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/admin.ns, size: 16MB, took 0.029 secs |
| m31102| Thu Aug 9 08:17:35 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state PRIMARY |
| m31100| Thu Aug 9 08:17:35 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/admin.0, filling with zeroes... |
| m31100| Thu Aug 9 08:17:35 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/admin.0, size: 16MB, took 0.028 secs |
| m31102| Thu Aug 9 08:17:35 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state RECOVERING |
| m31100| Thu Aug 9 08:17:35 [conn2] build index admin.foo { _id: 1 } |
| m31100| Thu Aug 9 08:17:35 [conn2] build index done. scanned 0 total records. 0 secs |
| ReplSetTest Timestamp(1344514655000, 1) |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31101 to have an oplog built. |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31102 to have an oplog built. |
2012-08-09 08:17:37 EDT | m31100| Thu Aug 9 08:17:35 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state RECOVERING |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31101 to have an oplog built. |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31102 to have an oplog built. |
2012-08-09 08:17:39 EDT | m31101| Thu Aug 9 08:17:37 [conn3] end connection 10.76.211.188:36588 (3 connections now open) |
| m31101| Thu Aug 9 08:17:37 [initandlisten] connection accepted from 10.76.211.188:36603 #5 (4 connections now open) |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31101 to have an oplog built. |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31102 to have an oplog built. |
2012-08-09 08:17:41 EDT | m31100| Thu Aug 9 08:17:40 [conn3] end connection 10.76.211.188:45717 (3 connections now open) |
| m31100| Thu Aug 9 08:17:40 [initandlisten] connection accepted from 10.76.211.188:45732 #5 (4 connections now open) |
| m31100| Thu Aug 9 08:17:41 [conn4] end connection 10.76.211.188:45720 (3 connections now open) |
| m31100| Thu Aug 9 08:17:41 [initandlisten] connection accepted from 10.76.211.188:45733 #6 (4 connections now open) |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31101 to have an oplog built. |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31102 to have an oplog built. |
2012-08-09 08:17:43 EDT | m31101| Thu Aug 9 08:17:42 [rsSync] replSet initial sync pending |
| m31100| Thu Aug 9 08:17:42 [initandlisten] connection accepted from 10.76.211.188:45736 #7 (5 connections now open) |
| m31101| Thu Aug 9 08:17:42 [rsSync] build index local.me { _id: 1 } |
| m31101| Thu Aug 9 08:17:42 [rsSync] build index done. scanned 0 total records. 0.003 secs |
| m31101| Thu Aug 9 08:17:42 [rsSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m31101| Thu Aug 9 08:17:42 [rsSync] dropAllDatabasesExceptLocal 1 |
| m31101| Thu Aug 9 08:17:42 [rsSync] replSet initial sync clone all databases |
| m31101| Thu Aug 9 08:17:42 [rsSync] replSet initial sync cloning db: admin |
| m31100| Thu Aug 9 08:17:42 [initandlisten] connection accepted from 10.76.211.188:45737 #8 (6 connections now open) |
| m31101| Thu Aug 9 08:17:42 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/admin.ns, filling with zeroes... |
| m31101| Thu Aug 9 08:17:42 [rsSync] replSet initial sync drop all databases |
| m31101| Thu Aug 9 08:17:43 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/admin.0, filling with zeroes... |
| m31101| Thu Aug 9 08:17:43 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/admin.0, size: 16MB, took 0.071 secs |
| m31101| Thu Aug 9 08:17:43 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/admin.ns, size: 16MB, took 0.031 secs |
| m31101| Thu Aug 9 08:17:43 [rsSync] build index admin.foo { _id: 1 } |
| m31101| Thu Aug 9 08:17:43 [rsSync] fastBuildIndex dupsToDrop:0 |
| m31100| Thu Aug 9 08:17:43 [conn8] end connection 10.76.211.188:45737 (5 connections now open) |
| m31101| Thu Aug 9 08:17:43 [rsSync] build index done. scanned 1 total records. 0 secs |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync building indexes |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync cloning indexes for : admin |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync data copy, starting syncup |
| m31100| Thu Aug 9 08:17:43 [initandlisten] connection accepted from 10.76.211.188:45738 #9 (6 connections now open) |
| m31100| Thu Aug 9 08:17:43 [conn9] end connection 10.76.211.188:45738 (5 connections now open) |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync finishing up |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync query minValid |
| m31101| Thu Aug 9 08:17:43 [rsSync] build index local.replset.minvalid { _id: 1 } |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet set minValid=5023aa5f:1 |
| m31101| Thu Aug 9 08:17:43 [rsSync] build index done. scanned 0 total records. 0 secs |
| m31100| Thu Aug 9 08:17:43 [conn7] end connection 10.76.211.188:45736 (4 connections now open) |
| m31101| Thu Aug 9 08:17:43 [rsSync] replSet initial sync done |
| "ts" : Timestamp(1344514655000, 1), |
| "h" : NumberLong("5935269659153530897"), |
| "op" : "i", |
| "ns" : "admin.foo", |
| "o" : { |
| "_id" : ObjectId("5023aa5f4775220dd9c69924"), |
| "x" : 1 |
| } |
| { |
| } |
| ReplSetTest await TS for connection to bs-rhel-57-64-2:31101 is 1344514655000:1 and latest is 1344514655000:1 |
| ReplSetTest await oplog size for connection to bs-rhel-57-64-2:31101 is 1 |
| ReplSetTest waiting for connection to bs-rhel-57-64-2:31102 to have an oplog built. |
2012-08-09 08:17:44 EDT | m31100| Thu Aug 9 08:17:43 [initandlisten] connection accepted from 10.76.211.188:45741 #10 (5 connections now open) |
| m31101| Thu Aug 9 08:17:43 [rsBackgroundSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:17:44 [initandlisten] connection accepted from 10.76.211.188:45742 #11 (6 connections now open) |
| m31101| Thu Aug 9 08:17:44 [rsSyncNotifier] replset setting oplog notifier to bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync pending |
| m31100| Thu Aug 9 08:17:44 [initandlisten] connection accepted from 10.76.211.188:45743 #12 (7 connections now open) |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index local.me { _id: 1 } |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index done. scanned 0 total records. 0.001 secs |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync drop all databases |
| m31102| Thu Aug 9 08:17:44 [rsSync] dropAllDatabasesExceptLocal 1 |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync clone all databases |
| m31100| Thu Aug 9 08:17:44 [initandlisten] connection accepted from 10.76.211.188:45744 #13 (8 connections now open) |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync cloning db: admin |
| m31102| Thu Aug 9 08:17:44 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/admin.ns, filling with zeroes... |
| m31102| Thu Aug 9 08:17:44 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/admin.0, filling with zeroes... |
| m31102| Thu Aug 9 08:17:44 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/admin.0, size: 16MB, took 0.03 secs |
| m31102| Thu Aug 9 08:17:44 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/admin.ns, size: 16MB, took 0.032 secs |
| m31102| Thu Aug 9 08:17:44 [rsSync] fastBuildIndex dupsToDrop:0 |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index admin.foo { _id: 1 } |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index done. scanned 1 total records. 0 secs |
| m31100| Thu Aug 9 08:17:44 [conn13] end connection 10.76.211.188:45744 (7 connections now open) |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync building indexes |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync cloning indexes for : admin |
| m31100| Thu Aug 9 08:17:44 [initandlisten] connection accepted from 10.76.211.188:45745 #14 (8 connections now open) |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync data copy, starting syncup |
| m31100| Thu Aug 9 08:17:44 [conn14] end connection 10.76.211.188:45745 (7 connections now open) |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync finishing up |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync query minValid |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index local.replset.minvalid { _id: 1 } |
| m31102| Thu Aug 9 08:17:44 [rsSync] build index done. scanned 0 total records. 0 secs |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet initial sync done |
| m31102| Thu Aug 9 08:17:44 [rsSync] replSet set minValid=5023aa5f:1 |
| m31100| Thu Aug 9 08:17:44 [conn12] end connection 10.76.211.188:45743 (6 connections now open) |
| m31100| Thu Aug 9 08:17:45 [slaveTracking] build index done. scanned 0 total records. 0.001 secs |
| m31100| Thu Aug 9 08:17:45 [slaveTracking] build index local.slaves { _id: 1 } |
| m31101| Thu Aug 9 08:17:45 [rsSync] replSet SECONDARY |
| m31102| Thu Aug 9 08:17:45 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state SECONDARY |
| "ts" : Timestamp(1344514655000, 1), |
| "h" : NumberLong("5935269659153530897"), |
| "op" : "i", |
| "ns" : "admin.foo", |
| "o" : { |
| "_id" : ObjectId("5023aa5f4775220dd9c69924"), |
| "x" : 1 |
| } |
| { |
| ReplSetTest await TS for connection to bs-rhel-57-64-2:31101 is 1344514655000:1 and latest is 1344514655000:1 |
| } |
| ReplSetTest await oplog size for connection to bs-rhel-57-64-2:31101 is 1 |
| "ts" : Timestamp(1344514655000, 1), |
| "h" : NumberLong("5935269659153530897"), |
| "op" : "i", |
| "ns" : "admin.foo", |
| "o" : { |
| "_id" : ObjectId("5023aa5f4775220dd9c69924"), |
| "x" : 1 |
| } |
| { |
| ReplSetTest await TS for connection to bs-rhel-57-64-2:31102 is 1344514655000:1 and latest is 1344514655000:1 |
| ReplSetTest await oplog size for connection to bs-rhel-57-64-2:31102 is 1 |
| ReplSetTest await synced=true |
| } |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45748 #15 (7 connections now open) |
| Thu Aug 9 08:17:45 starting new replica set monitor for replica set replReads-rs0 with seed of bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| Thu Aug 9 08:17:45 changing hosts to { 0: "bs-rhel-57-64-2:31100", 1: "bs-rhel-57-64-2:31102", 2: "bs-rhel-57-64-2:31101" } from replReads-rs0/ |
| Thu Aug 9 08:17:45 successfully connected to seed bs-rhel-57-64-2:31100 for replica set replReads-rs0 |
| Thu Aug 9 08:17:45 trying to add new host bs-rhel-57-64-2:31100 to replica set replReads-rs0 |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45749 #16 (8 connections now open) |
| Thu Aug 9 08:17:45 successfully connected to new host bs-rhel-57-64-2:31100 in replica set replReads-rs0 |
| m31101| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:36624 #6 (5 connections now open) |
| Thu Aug 9 08:17:45 successfully connected to new host bs-rhel-57-64-2:31101 in replica set replReads-rs0 |
| Thu Aug 9 08:17:45 trying to add new host bs-rhel-57-64-2:31101 to replica set replReads-rs0 |
| m31102| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:47665 #5 (5 connections now open) |
| Thu Aug 9 08:17:45 successfully connected to new host bs-rhel-57-64-2:31102 in replica set replReads-rs0 |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45752 #17 (9 connections now open) |
| m31100| Thu Aug 9 08:17:45 [conn15] end connection 10.76.211.188:45748 (8 connections now open) |
| Thu Aug 9 08:17:45 trying to add new host bs-rhel-57-64-2:31102 to replica set replReads-rs0 |
| m31101| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:36627 #7 (6 connections now open) |
| m31102| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:47668 #6 (6 connections now open) |
| Thu Aug 9 08:17:45 Primary for replica set replReads-rs0 changed to bs-rhel-57-64-2:31100 |
| Thu Aug 9 08:17:45 [ReplicaSetMonitorWatcher] starting |
| Thu Aug 9 08:17:45 replica set monitor for replica set replReads-rs0 started, address is replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45755 #18 (9 connections now open) |
| Resetting db path '/data/db/replReads-config0' |
| Thu Aug 9 08:17:45 shell: started program /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/mongod --port 29000 --dbpath /data/db/replReads-config0 --configsvr |
| m29000| Thu Aug 9 08:17:45 [initandlisten] MongoDB starting : pid=1070 port=29000 dbpath=/data/db/replReads-config0 64-bit host=bs-rhel-57-64-2 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] build info: Linux bs-rhel-57-64-2 2.6.18-274.el5xen #1 SMP Fri Jul 8 17:45:44 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] journal dir=/data/db/replReads-config0/journal |
| m29000| Thu Aug 9 08:17:45 [initandlisten] options: { configsvr: true, dbpath: "/data/db/replReads-config0", port: 29000 } |
| m29000| Thu Aug 9 08:17:45 [initandlisten] recover : no journal files present, no recovery needed |
| m29000| Thu Aug 9 08:17:45 [initandlisten] waiting for connections on port 29000 |
| m29000| Thu Aug 9 08:17:45 [websvr] admin web console waiting for connections on port 30000 |
| m31100| Thu Aug 9 08:17:45 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state SECONDARY |
| "bs-rhel-57-64-2:29000" |
| ShardingTest replReads : |
| "config" : "bs-rhel-57-64-2:29000", |
| "shards" : [ |
| connection to replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| ] |
| { |
| } |
| Thu Aug 9 08:17:45 shell: started program /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/mongos --port 30999 --configdb bs-rhel-57-64-2:29000 --chunkSize 1 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 127.0.0.1:50016 #1 (1 connection now open) |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54083 #2 (2 connections now open) |
| m30999| Thu Aug 9 08:17:45 [mongosMain] MongoS version 2.2.0-rc1-pre- starting: pid=1085 port=30999 64-bit host=bs-rhel-57-64-2 (--help for usage) |
| m30999| Thu Aug 9 08:17:45 [mongosMain] git version: 78de2819dca377af2e4c26b1160832336a573126 |
| m30999| Thu Aug 9 08:17:45 warning: running with 1 config server should be done only for testing purposes and is not recommended for production |
| m30999| Thu Aug 9 08:17:45 [mongosMain] build info: Linux bs-rhel-57-64-2 2.6.18-274.el5xen #1 SMP Fri Jul 8 17:45:44 EDT 2011 x86_64 BOOST_LIB_VERSION=1_49 |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54085 #3 (3 connections now open) |
| m30999| Thu Aug 9 08:17:45 [mongosMain] options: { chunkSize: 1, configdb: "bs-rhel-57-64-2:29000", port: 30999 } |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54086 #4 (4 connections now open) |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] allocating new datafile /data/db/replReads-config0/config.ns, filling with zeroes... |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] creating directory /data/db/replReads-config0/_tmp |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] done allocating datafile /data/db/replReads-config0/config.ns, size: 16MB, took 0.027 secs |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54087 #5 (5 connections now open) |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] allocating new datafile /data/db/replReads-config0/config.0, filling with zeroes... |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] allocating new datafile /data/db/replReads-config0/config.1, filling with zeroes... |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] done allocating datafile /data/db/replReads-config0/config.0, size: 16MB, took 0.028 secs |
| m29000| Thu Aug 9 08:17:45 [conn4] build index config.version { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn4] build index done. scanned 0 total records. 0 secs |
| m31102| Thu Aug 9 08:17:45 [rsBackgroundSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:17:45 [mongosMain] waiting for connections on port 30999 |
| m30999| Thu Aug 9 08:17:45 [Balancer] about to contact config servers and shards |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.settings { _id: 1 } |
| m30999| Thu Aug 9 08:17:45 [websvr] admin web console waiting for connections on port 31999 |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0.002 secs |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45764 #19 (10 connections now open) |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.chunks { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] info: creating collection config.chunks on add index |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.chunks { ns: 1, min: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.chunks { ns: 1, shard: 1, min: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.chunks { ns: 1, lastmod: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.shards { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.shards { host: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] info: creating collection config.shards on add index |
| m30999| Thu Aug 9 08:17:45 [Balancer] config servers and shards contacted successfully |
| m30999| Thu Aug 9 08:17:45 [Balancer] balancer id: bs-rhel-57-64-2:30999 started at Aug 9 08:17:45 |
| m29000| Thu Aug 9 08:17:45 [conn4] build index config.mongos { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn4] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54089 #6 (6 connections now open) |
| m30999| Thu Aug 9 08:17:45 [Balancer] created new distributed lock for balancer on bs-rhel-57-64-2:29000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) |
| m30999| Thu Aug 9 08:17:45 [LockPinger] creating distributed lock ping thread for bs-rhel-57-64-2:29000 and process bs-rhel-57-64-2:30999:1344514665:1804289383 (sleeping for 30000ms) |
| m29000| Thu Aug 9 08:17:45 [conn6] build index config.locks { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn6] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.lockpings { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [conn3] build index config.lockpings { ping: 1 } |
| m30999| Thu Aug 9 08:17:45 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' acquired, ts : 5023aa696ce4b800cda415c5 |
| m29000| Thu Aug 9 08:17:45 [conn3] build index done. scanned 1 total records. 0 secs |
| m29000| Thu Aug 9 08:17:45 [FileAllocator] done allocating datafile /data/db/replReads-config0/config.1, size: 32MB, took 0.055 secs |
| m30999| Thu Aug 9 08:17:45 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' unlocked. |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45766 #20 (11 connections now open) |
| m31102| Thu Aug 9 08:17:45 [rsSyncNotifier] replset setting oplog notifier to bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:17:45 [mongosMain] connection accepted from 127.0.0.1:59123 #1 (1 connection now open) |
| ShardingTest undefined going to add shard : replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m29000| Thu Aug 9 08:17:45 [conn5] build index config.databases { _id: 1 } |
| m29000| Thu Aug 9 08:17:45 [conn5] build index done. scanned 0 total records. 0 secs |
| m30999| Thu Aug 9 08:17:45 [conn1] couldn't find database [admin] in config db |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45768 #21 (12 connections now open) |
| m30999| Thu Aug 9 08:17:45 [conn1] put [admin] on: config:bs-rhel-57-64-2:29000 |
| m30999| Thu Aug 9 08:17:45 [conn1] starting new replica set monitor for replica set replReads-rs0 with seed of bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45769 #22 (13 connections now open) |
| m31101| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:36644 #8 (7 connections now open) |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45772 #23 (14 connections now open) |
| m31101| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:36647 #9 (8 connections now open) |
| m31100| Thu Aug 9 08:17:45 [conn21] end connection 10.76.211.188:45768 (13 connections now open) |
| m30999| Thu Aug 9 08:17:45 [conn1] successfully connected to seed bs-rhel-57-64-2:31100 for replica set replReads-rs0 |
| m31102| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:47685 #7 (7 connections now open) |
| m30999| Thu Aug 9 08:17:45 [conn1] changing hosts to { 0: "bs-rhel-57-64-2:31100", 1: "bs-rhel-57-64-2:31102", 2: "bs-rhel-57-64-2:31101" } from replReads-rs0/ |
| m30999| Thu Aug 9 08:17:45 [conn1] successfully connected to new host bs-rhel-57-64-2:31100 in replica set replReads-rs0 |
| m30999| Thu Aug 9 08:17:45 [conn1] trying to add new host bs-rhel-57-64-2:31100 to replica set replReads-rs0 |
| m30999| Thu Aug 9 08:17:45 [conn1] trying to add new host bs-rhel-57-64-2:31101 to replica set replReads-rs0 |
| m30999| Thu Aug 9 08:17:45 [conn1] successfully connected to new host bs-rhel-57-64-2:31101 in replica set replReads-rs0 |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45775 #24 (14 connections now open) |
| m31102| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:47688 #8 (8 connections now open) |
| m30999| Thu Aug 9 08:17:45 [conn1] successfully connected to new host bs-rhel-57-64-2:31102 in replica set replReads-rs0 |
| m30999| Thu Aug 9 08:17:45 [conn1] Primary for replica set replReads-rs0 changed to bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:17:45 [conn1] replica set monitor for replica set replReads-rs0 started, address is replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m30999| Thu Aug 9 08:17:45 [ReplicaSetMonitorWatcher] starting |
| m30999| Thu Aug 9 08:17:45 [conn1] trying to add new host bs-rhel-57-64-2:31102 to replica set replReads-rs0 |
| m30999| Thu Aug 9 08:17:45 [conn1] going to add shard: { _id: "replReads-rs0", host: "replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102" } |
| { "shardAdded" : "replReads-rs0", "ok" : 1 } |
| m30999| Thu Aug 9 08:17:45 [conn1] put [test] on: replReads-rs0:replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m30999| Thu Aug 9 08:17:45 [conn1] couldn't find database [test] in config db |
| m30999| Thu Aug 9 08:17:45 [conn1] enabling sharding on: test |
| m31100| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:45776 #25 (15 connections now open) |
| m29000| Thu Aug 9 08:17:45 [initandlisten] connection accepted from 10.76.211.188:54101 #7 (7 connections now open) |
| m30999| Thu Aug 9 08:17:45 [conn1] creating WriteBackListener for: bs-rhel-57-64-2:31100 serverID: 5023aa696ce4b800cda415c4 |
| m30999| Thu Aug 9 08:17:45 [conn1] creating WriteBackListener for: bs-rhel-57-64-2:31101 serverID: 5023aa696ce4b800cda415c4 |
| m30999| Thu Aug 9 08:17:45 [conn1] creating WriteBackListener for: bs-rhel-57-64-2:31102 serverID: 5023aa696ce4b800cda415c4 |
| m30999| Thu Aug 9 08:17:45 [conn1] creating WriteBackListener for: bs-rhel-57-64-2:29000 serverID: 5023aa696ce4b800cda415c4 |
| { "_id" : "chunksize", "value" : 1 } |
| m31100| Thu Aug 9 08:17:45 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/test.ns, filling with zeroes... |
| m30999| Thu Aug 9 08:17:45 [conn1] CMD: shardcollection: { shardcollection: "test.foo", key: { _id: 1.0 } } |
| m30999| Thu Aug 9 08:17:45 [conn1] enable sharding on: test.foo with shard key: { _id: 1.0 } |
| m31100| Thu Aug 9 08:17:46 [FileAllocator] allocating new datafile /data/db/replReads-rs0-0/test.0, filling with zeroes... |
| m31100| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/test.ns, size: 16MB, took 0.028 secs |
| m31100| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-0/test.0, size: 16MB, took 0.027 secs |
| m31100| Thu Aug 9 08:17:46 [conn24] build index done. scanned 0 total records. 0 secs |
| m31100| Thu Aug 9 08:17:46 [conn24] build index test.foo { _id: 1 } |
| m31100| Thu Aug 9 08:17:46 [conn24] info: creating collection test.foo on add index |
| m31102| Thu Aug 9 08:17:46 [rsSync] replSet SECONDARY |
| m31101| Thu Aug 9 08:17:46 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/test.ns, filling with zeroes... |
| m30999| Thu Aug 9 08:17:46 [conn1] going to create 1 chunk(s) for: test.foo using new epoch 5023aa6a6ce4b800cda415c6 |
| m31102| Thu Aug 9 08:17:46 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/test.ns, filling with zeroes... |
| m30999| Thu Aug 9 08:17:46 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 2 version: 1|0||5023aa6a6ce4b800cda415c6 based on: (empty) |
| m31102| Thu Aug 9 08:17:46 [FileAllocator] allocating new datafile /data/db/replReads-rs0-2/test.0, filling with zeroes... |
| m31102| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/test.ns, size: 16MB, took 0.038 secs |
| m31101| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/test.ns, size: 16MB, took 0.039 secs |
| m29000| Thu Aug 9 08:17:46 [conn5] build index config.collections { _id: 1 } |
| m29000| Thu Aug 9 08:17:46 [conn5] build index done. scanned 0 total records. 0 secs |
| m29000| Thu Aug 9 08:17:46 [initandlisten] connection accepted from 10.76.211.188:54102 #8 (8 connections now open) |
| m31101| Thu Aug 9 08:17:46 [FileAllocator] allocating new datafile /data/db/replReads-rs0-1/test.0, filling with zeroes... |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| }, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| m31100| Thu Aug 9 08:17:46 [conn25] no current chunk manager found for this shard, will initialize |
| m31101| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-1/test.0, size: 16MB, took 0.043 secs |
| m31102| Thu Aug 9 08:17:46 [FileAllocator] done allocating datafile /data/db/replReads-rs0-2/test.0, size: 16MB, took 0.055 secs |
| m31102| Thu Aug 9 08:17:46 [repl writer worker 1] build index done. scanned 0 total records. 0 secs |
| m31102| Thu Aug 9 08:17:46 [repl writer worker 1] build index test.foo { _id: 1 } |
| m31101| Thu Aug 9 08:17:46 [repl writer worker 1] build index test.foo { _id: 1 } |
| m31102| Thu Aug 9 08:17:46 [repl writer worker 1] info: creating collection test.foo on add index |
| m31101| Thu Aug 9 08:17:46 [repl writer worker 1] build index done. scanned 0 total records. 0 secs |
| m31101| Thu Aug 9 08:17:46 [repl writer worker 1] info: creating collection test.foo on add index |
| m31101| Thu Aug 9 08:17:46 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state SECONDARY |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| }, |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| m31100| Thu Aug 9 08:17:47 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state SECONDARY |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| [ |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| [ |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| }, |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| }, |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| [ |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| { |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| [ |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| }, |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| { |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| { |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| }, |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| m31102| Thu Aug 9 08:17:51 [conn3] end connection 10.76.211.188:47630 (7 connections now open) |
| m31102| Thu Aug 9 08:17:51 [initandlisten] connection accepted from 10.76.211.188:47701 #9 (8 connections now open) |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| m30999| Thu Aug 9 08:17:51 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' acquired, ts : 5023aa6f6ce4b800cda415c7 |
| m30999| Thu Aug 9 08:17:51 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' unlocked. |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| [ |
| }, |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| { |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| } |
| ] |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| [ |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| [ |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| { |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| }, |
| "pingTimeMillis" : 0 |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| m31102| Thu Aug 9 08:17:54 [conn4] end connection 10.76.211.188:47635 (7 connections now open) |
| m31102| Thu Aug 9 08:17:54 [initandlisten] connection accepted from 10.76.211.188:47706 #10 (8 connections now open) |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| [ |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| [ |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| [ |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ismaster" : true, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| [ |
| "pingTimeMillis" : 0 |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| m31101| Thu Aug 9 08:17:55 [conn4] end connection 10.76.211.188:36598 (7 connections now open) |
| m31101| Thu Aug 9 08:17:55 [initandlisten] connection accepted from 10.76.211.188:36667 #10 (8 connections now open) |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| [ |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : false, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| [ |
| "hidden" : false, |
| "ismaster" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| [ |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : false, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| ] |
| m31100| Thu Aug 9 08:17:55 [initandlisten] connection accepted from 10.76.211.188:45796 #26 (16 connections now open) |
| m31101| Thu Aug 9 08:17:55 [initandlisten] connection accepted from 10.76.211.188:36671 #11 (9 connections now open) |
| m31102| Thu Aug 9 08:17:55 [initandlisten] connection accepted from 10.76.211.188:47712 #11 (9 connections now open) |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : true, |
| "ismaster" : false, |
| [ |
| "hidden" : false, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| } |
| ] |
| m31101| Thu Aug 9 08:17:56 [conn2] creating profile collection: test.system.profile |
| m31100| Thu Aug 9 08:17:56 [conn2] creating profile collection: test.system.profile |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59293 #2 (2 connections now open) |
| m31102| Thu Aug 9 08:17:56 [conn2] creating profile collection: test.system.profile |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45800 #27 (17 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59296 #3 (3 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45803 #28 (18 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36675 #12 (10 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47718 #12 (10 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59299 #4 (4 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45806 #29 (19 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59302 #5 (5 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45809 #30 (20 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36681 #13 (11 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47724 #13 (11 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59305 #6 (6 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45812 #31 (21 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36687 #14 (12 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59308 #7 (7 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45815 #32 (22 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59311 #8 (8 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45818 #33 (23 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36693 #15 (13 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59314 #9 (9 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47730 #14 (12 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45821 #34 (24 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59317 #10 (10 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45824 #35 (25 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47736 #15 (13 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59320 #11 (11 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45827 #36 (26 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36699 #16 (14 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47742 #16 (14 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59323 #12 (12 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45830 #37 (27 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36705 #17 (15 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59326 #13 (13 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45833 #38 (28 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47748 #17 (15 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59329 #14 (14 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45836 #39 (29 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59332 #15 (15 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45839 #40 (30 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36711 #18 (16 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36717 #19 (17 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47754 #18 (16 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59335 #16 (16 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59338 #17 (17 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45842 #41 (31 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45845 #42 (32 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59341 #18 (18 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47760 #19 (17 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45848 #43 (33 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36723 #20 (18 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59344 #19 (19 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45851 #44 (34 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59347 #20 (20 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45854 #45 (35 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47766 #20 (18 connections now open) |
| m30999| Thu Aug 9 08:17:56 [mongosMain] connection accepted from 10.76.211.188:59350 #21 (21 connections now open) |
| m31101| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:36729 #21 (19 connections now open) |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:45857 #46 (36 connections now open) |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47772 #21 (19 connections now open) |
| "set" : "replReads-rs0", |
| "date" : ISODate("2012-08-09T12:17:56Z"), |
| "myState" : 1, |
| "members" : [ |
| { |
| "_id" : 0, |
| "name" : "bs-rhel-57-64-2:31100", |
| "health" : 1, |
| "state" : 1, |
| "stateStr" : "PRIMARY", |
| "uptime" : 53, |
| { |
| "optime" : Timestamp(1344514666000, 2), |
| "optimeDate" : ISODate("2012-08-09T12:17:46Z"), |
| "self" : true |
| { |
| "_id" : 1, |
| "name" : "bs-rhel-57-64-2:31101", |
| "health" : 1, |
| "state" : 2, |
| "stateStr" : "SECONDARY", |
| "uptime" : 33, |
| "optime" : Timestamp(1344514666000, 2), |
| "optimeDate" : ISODate("2012-08-09T12:17:46Z"), |
| }, |
| "lastHeartbeat" : ISODate("2012-08-09T12:17:55Z"), |
| "pingMs" : 0 |
| { |
| "_id" : 2, |
| "name" : "bs-rhel-57-64-2:31102", |
| "health" : 1, |
| "state" : 2, |
| }, |
| "stateStr" : "SECONDARY", |
| "optime" : Timestamp(1344514666000, 2), |
| "optimeDate" : ISODate("2012-08-09T12:17:46Z"), |
| "lastHeartbeat" : ISODate("2012-08-09T12:17:55Z"), |
| "pingMs" : 0 |
| "uptime" : 33, |
| } |
| "ok" : 1 |
| ], |
| config before: { |
| "_id" : "replReads-rs0", |
| "version" : 1, |
| "members" : [ |
| { |
| "_id" : 0, |
| "host" : "bs-rhel-57-64-2:31100" |
| }, |
| { |
| "_id" : 1, |
| "host" : "bs-rhel-57-64-2:31101" |
| } |
| { |
| "_id" : 2, |
| "host" : "bs-rhel-57-64-2:31102" |
| } |
| }, |
| ] |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet replSetReconfig config object parses ok, 3 members specified |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet replSetReconfig [2] |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet info saving a newer config version to local.system.replset |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet saveConfigLocally done |
| } |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet SECONDARY |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet closing client sockets after relinquishing primary |
| m31100| Thu Aug 9 08:17:56 [conn1] end connection 10.76.211.188:45651 (35 connections now open) |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet PRIMARY |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet relinquishing primary state |
| m31102| Thu Aug 9 08:17:56 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:17:56 [WriteBackListener-bs-rhel-57-64-2:31100] DBClientCursor::init call() failed |
| m31100| Thu Aug 9 08:17:56 [conn10] SocketException handling request, closing client connection: 9001 socket exception [2] server [10.76.211.188:45741] |
| m31100| Thu Aug 9 08:17:56 [conn19] SocketException handling request, closing client connection: 9001 socket exception [2] server [10.76.211.188:45764] |
| m31100| Thu Aug 9 08:17:56 [conn2] replSet replSetReconfig new config saved locally |
| m31102| Thu Aug 9 08:17:56 [conn9] end connection 10.76.211.188:47701 (18 connections now open) |
| m29000| Thu Aug 9 08:17:56 [conn8] end connection 10.76.211.188:54102 (7 connections now open) |
| m31101| Thu Aug 9 08:17:56 [conn5] end connection 10.76.211.188:36603 (18 connections now open) |
| m31100| Thu Aug 9 08:17:56 [conn2] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:39222] |
| m31101| Thu Aug 9 08:17:56 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47774 #22 (19 connections now open) |
| m31100| Thu Aug 9 08:17:56 [rsHealthPoll] replSet info bs-rhel-57-64-2:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 10.76.211.188:31101 |
| m31100| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state DOWN |
| m31100| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state SECONDARY |
| m31100| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is up |
| Thu Aug 9 08:17:56 DBClientCursor::init call() failed |
| Thu Aug 9 08:17:56 query failed : admin.$cmd { replSetReconfig: { _id: "replReads-rs0", version: 2, members: [ { _id: 0, host: "bs-rhel-57-64-2:31100" }, { _id: 1, host: "bs-rhel-57-64-2:31101", hidden: true, priority: 0.0 }, { _id: 2, host: "bs-rhel-57-64-2:31102" } ] } } to: 127.0.0.1:31100 |
| m30999| Thu Aug 9 08:17:56 [WriteBackListener-bs-rhel-57-64-2:31100] WriteBackListener exception : DBClientBase::findN: transport error: bs-rhel-57-64-2:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023aa696ce4b800cda415c4') } |
| Thu Aug 9 08:17:56 trying reconnect to 127.0.0.1:31100 |
| m31100| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 127.0.0.1:39432 #47 (33 connections now open) |
| Thu Aug 9 08:17:56 reconnect 127.0.0.1:31100 ok |
| config after: { |
| "_id" : "replReads-rs0", |
| "version" : 2, |
| "members" : [ |
| { |
| "_id" : 0, |
| "host" : "bs-rhel-57-64-2:31100" |
| }, |
| { |
| "_id" : 1, |
| "host" : "bs-rhel-57-64-2:31101", |
| "priority" : 0, |
| "hidden" : true |
| }, |
| { |
| "_id" : 2, |
| reconnected to server after rs command (which is normal) |
| "host" : "bs-rhel-57-64-2:31102" |
| } |
| ] |
| { |
| "hosts" : [ |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| } |
| "ismaster" : false, |
| "hidden" : false, |
| "ok" : true, |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| } |
| "master" : 0, |
| "nextSlave" : 0 |
| ], |
| } |
| m31101| Thu Aug 9 08:17:56 [rsMgr] replSet info saving a newer config version to local.system.replset |
| m31101| Thu Aug 9 08:17:56 [rsMgr] replSet saveConfigLocally done |
| m31101| Thu Aug 9 08:17:56 [rsMgr] replset msgReceivedNewConfig version: version: 2 |
| m31102| Thu Aug 9 08:17:56 [conn10] end connection 10.76.211.188:47706 (18 connections now open) |
| m31101| Thu Aug 9 08:17:56 [rsMgr] replSet replSetReconfig new config saved locally |
| m31101| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is up |
| m31101| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is up |
| m31102| Thu Aug 9 08:17:56 [initandlisten] connection accepted from 10.76.211.188:47777 #23 (19 connections now open) |
| m31101| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state PRIMARY |
| m31101| Thu Aug 9 08:17:56 [rsHealthPoll] replSet member bs-rhel-57-64-2:31102 is now in state SECONDARY |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replSet info saving a newer config version to local.system.replset |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replSet saveConfigLocally done |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replset msgReceivedNewConfig version: version: 2 |
| m31101| Thu Aug 9 08:17:57 [conn10] end connection 10.76.211.188:36667 (17 connections now open) |
| m31102| Thu Aug 9 08:17:57 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is up |
| m31102| Thu Aug 9 08:17:57 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state PRIMARY |
| m31101| Thu Aug 9 08:17:57 [initandlisten] connection accepted from 10.76.211.188:36738 #22 (18 connections now open) |
| m31102| Thu Aug 9 08:17:57 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is up |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replSet replSetReconfig new config saved locally |
| m31102| Thu Aug 9 08:17:57 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state SECONDARY |
| m31102| Thu Aug 9 08:17:57 [rsMgr] not electing self, we are not freshest |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2 |
| m31102| Thu Aug 9 08:17:57 [rsMgr] replset msgReceivedNewConfig version: version: 2 |
| m30999| Thu Aug 9 08:17:57 [WriteBackListener-bs-rhel-57-64-2:31100] Socket recv() errno:104 Connection reset by peer 10.76.211.188:31100 |
| m30999| Thu Aug 9 08:17:57 [WriteBackListener-bs-rhel-57-64-2:31100] DBClientCursor::init call() failed |
| m30999| Thu Aug 9 08:17:57 [WriteBackListener-bs-rhel-57-64-2:31100] SocketException: remote: 10.76.211.188:31100 error: 9001 socket exception [1] server [10.76.211.188:31100] |
| m30999| Thu Aug 9 08:17:57 [WriteBackListener-bs-rhel-57-64-2:31100] WriteBackListener exception : DBClientBase::findN: transport error: bs-rhel-57-64-2:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023aa696ce4b800cda415c4') } |
| m31100| Thu Aug 9 08:17:57 [conn26] end connection 10.76.211.188:45796 (32 connections now open) |
| m31100| Thu Aug 9 08:17:57 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| m31100| Thu Aug 9 08:17:57 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| m30999| Thu Aug 9 08:17:57 [Balancer] Socket recv() errno:104 Connection reset by peer 10.76.211.188:31100 |
| m30999| Thu Aug 9 08:17:57 [Balancer] SocketException: remote: 10.76.211.188:31100 error: 9001 socket exception [1] server [10.76.211.188:31100] |
| m30999| Thu Aug 9 08:17:57 [Balancer] DBClientCursor::init call() failed |
| m30999| Thu Aug 9 08:17:57 [Balancer] caught exception while doing balance: DBClientBase::findN: transport error: bs-rhel-57-64-2:31100 ns: admin.$cmd query: { features: 1 } |
| m30999| Thu Aug 9 08:17:57 [Balancer] scoped connection to bs-rhel-57-64-2:29000 not being returned to the pool |
| m29000| Thu Aug 9 08:17:57 [conn4] end connection 10.76.211.188:54086 (6 connections now open) |
| m31100| Thu Aug 9 08:17:57 [conn24] end connection 10.76.211.188:45775 (31 connections now open) |
| m31101| Thu Aug 9 08:17:58 [initandlisten] connection accepted from 10.76.211.188:36739 #23 (19 connections now open) |
2012-08-09 08:18:01 EDT | m31100| Thu Aug 9 08:17:58 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is up |
| m31100| Thu Aug 9 08:17:58 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state SECONDARY |
| m31101| Thu Aug 9 08:17:58 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| m31101| Thu Aug 9 08:17:58 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| m31102| Thu Aug 9 08:17:59 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| m31100| Thu Aug 9 08:17:59 [initandlisten] connection accepted from 10.76.211.188:45868 #48 (32 connections now open) |
| m31102| Thu Aug 9 08:17:59 [rsHealthPoll] ERROR: Client::shutdown not called: rsHealthPoll |
| "hosts" : [ |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31101", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| { |
| "pingTimeMillis" : 0 |
| "secondary" : true, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| } |
| }, |
| "master" : 0, |
| "nextSlave" : 0 |
| ], |
| } |
2012-08-09 08:18:05 EDT | m29000| Thu Aug 9 08:18:03 [initandlisten] connection accepted from 10.76.211.188:54195 #9 (7 connections now open) |
| m30999| Thu Aug 9 08:18:03 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' acquired, ts : 5023aa7b6ce4b800cda415c8 |
| m30999| Thu Aug 9 08:18:03 [Balancer] distributed lock 'balancer/bs-rhel-57-64-2:30999:1344514665:1804289383' unlocked. |
| m31100| Thu Aug 9 08:18:03 [initandlisten] connection accepted from 10.76.211.188:45872 #49 (33 connections now open) |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 10.76.211.188:31100 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] SocketException: remote: 10.76.211.188:31100 error: 9001 socket exception [1] server [10.76.211.188:31100] |
| m31100| Thu Aug 9 08:18:05 [conn16] end connection 10.76.211.188:45749 (32 connections now open) |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] reconnect bs-rhel-57-64-2:31100 ok |
| m31100| Thu Aug 9 08:18:05 [initandlisten] connection accepted from 10.76.211.188:45873 #50 (33 connections now open) |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] trying reconnect to bs-rhel-57-64-2:31100 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] changing hosts to { 0: "bs-rhel-57-64-2:31100", 1: "bs-rhel-57-64-2:31102" } from replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 10.76.211.188:31100 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] erasing host { addr: "bs-rhel-57-64-2:31101", isMaster: false, secondary: true, hidden: false, ok: true } from replica set replReads-rs0 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] Primary for replica set replReads-rs0 changed to bs-rhel-57-64-2:31100 |
| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] SocketException: remote: 10.76.211.188:31100 error: 9001 socket exception [1] server [10.76.211.188:31100] |
| m31100| Thu Aug 9 08:18:05 [conn17] end connection 10.76.211.188:45752 (32 connections now open) |
| m31100| Thu Aug 9 08:18:05 [initandlisten] connection accepted from 10.76.211.188:45875 #51 (33 connections now open) |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 10.76.211.188:31100 |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] SocketException: remote: 10.76.211.188:31100 error: 9001 socket exception [1] server [10.76.211.188:31100] |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed |
| m31100| Thu Aug 9 08:18:05 [conn22] end connection 10.76.211.188:45769 (32 connections now open) |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] trying reconnect to bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] reconnect bs-rhel-57-64-2:31100 ok |
| m31100| Thu Aug 9 08:18:05 [initandlisten] connection accepted from 10.76.211.188:45877 #52 (33 connections now open) |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] changing hosts to { 0: "bs-rhel-57-64-2:31100", 1: "bs-rhel-57-64-2:31102" } from replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102 |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] Primary for replica set replReads-rs0 changed to bs-rhel-57-64-2:31100 |
| m30999| Thu Aug 9 08:18:05 [ReplicaSetMonitorWatcher] erasing host { addr: "bs-rhel-57-64-2:31101", isMaster: false, secondary: true, hidden: false, ok: true } from replica set replReads-rs0 |
| m31101| Thu Aug 9 08:18:05 [conn8] end connection 10.76.211.188:36644 (18 connections now open) |
| m31100| Thu Aug 9 08:18:05 [initandlisten] connection accepted from 10.76.211.188:45878 #53 (34 connections now open) |
| m31101| Thu Aug 9 08:18:06 [rsBackgroundSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:18:06 [rsBackgroundSync] replSet syncing to: bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45879 #54 (35 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45880 #55 (36 connections now open) |
| m31100| Thu Aug 9 08:18:06 [conn20] end connection 10.76.211.188:45766 (35 connections now open) |
| m31101| Thu Aug 9 08:18:06 [rsSyncNotifier] replset setting oplog notifier to bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:18:06 [rsSyncNotifier] replset setting oplog notifier to bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:18:06 [conn11] end connection 10.76.211.188:45742 (34 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45881 #56 (35 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45882 #57 (36 connections now open) |
| "hosts" : [ |
| { |
| "addr" : "bs-rhel-57-64-2:31100", |
| "ok" : true, |
| "ismaster" : true, |
| "hidden" : false, |
| "secondary" : false, |
| "pingTimeMillis" : 0 |
| }, |
| { |
| "addr" : "bs-rhel-57-64-2:31102", |
| "ok" : true, |
| "ismaster" : false, |
| "hidden" : false, |
| "secondary" : true, |
| "pingTimeMillis" : 0 |
| { |
| } |
| "master" : 0, |
| "nextSlave" : 0 |
| ], |
| } |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59377 #22 (22 connections now open) |
| m31100| Thu Aug 9 08:18:06 [conn58] no current chunk manager found for this shard, will initialize |
| m31100| Thu Aug 9 08:18:06 [conn58] Socket say send() errno:9 Bad file descriptor 10.76.211.188:29000 |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45884 #58 (37 connections now open) |
| m31100| Thu Aug 9 08:18:06 [conn58] command admin.$cmd command: { setShardVersion: "test.foo", configdb: "bs-rhel-57-64-2:29000", version: Timestamp 1000|0, versionEpoch: ObjectId('5023aa6a6ce4b800cda415c6'), serverID: ObjectId('5023aa696ce4b800cda415c4'), authoritative: true, shard: "replReads-rs0", shardHost: "replReads-rs0/bs-rhel-57-64-2:31100,bs-rhel-57-64-2:31101,bs-rhel-57-64-2:31102", $auth: {} } ntoreturn:1 keyUpdates:0 numYields: 1 locks(micros) W:4 reslen:173 154ms |
| m29000| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:54209 #10 (8 connections now open) |
| m31100| Thu Aug 9 08:18:06 [conn58] no current chunk manager found for this shard, will initialize |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47800 #24 (20 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59381 #23 (23 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45888 #59 (38 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59384 #24 (24 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47803 #25 (21 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45891 #60 (39 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47806 #26 (22 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59387 #25 (25 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45894 #61 (40 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59390 #26 (26 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45897 #62 (41 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47809 #27 (23 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59393 #27 (27 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45900 #63 (42 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47812 #28 (24 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47815 #29 (25 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59396 #28 (28 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45903 #64 (43 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59399 #29 (29 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47818 #30 (26 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45906 #65 (44 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59402 #30 (30 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45909 #66 (45 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47821 #31 (27 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59405 #31 (31 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47824 #32 (28 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45912 #67 (46 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59408 #32 (32 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45915 #68 (47 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47827 #33 (29 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47830 #34 (30 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59411 #33 (33 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45918 #69 (48 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59414 #34 (34 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45921 #70 (49 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47833 #35 (31 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59417 #35 (35 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45924 #71 (50 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47836 #36 (32 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59420 #36 (36 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47839 #37 (33 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45927 #72 (51 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59423 #37 (37 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45930 #73 (52 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47842 #38 (34 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47845 #39 (35 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59426 #38 (38 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45933 #74 (53 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59429 #39 (39 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47848 #40 (36 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45936 #75 (54 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45939 #76 (55 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59432 #40 (40 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47851 #41 (37 connections now open) |
| m30999| Thu Aug 9 08:18:06 [mongosMain] connection accepted from 10.76.211.188:59435 #41 (41 connections now open) |
| m31100| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:45942 #77 (56 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47854 #42 (38 connections now open) |
| m31102| Thu Aug 9 08:18:06 [initandlisten] connection accepted from 10.76.211.188:47857 #43 (39 connections now open) |
| assert: [20] != [19] are not equal : counts wrong: [ 13, 32 ] |
| ()@src/mongo/shell/utils.js:37 |
| ("[20] != [19] are not equal : counts wrong: [ 13, 32 ]")@src/mongo/shell/utils.js:58 |
| (20,19,"counts wrong: [ 13, 32 ]")@src/mongo/shell/utils.js:88 |
| Error("Printing Stack Trace")@:0 |
| @/data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/jstests/slowNightly/replReads.js:118 |
| |
| Thu Aug 9 08:18:06 uncaught exception: [20] != [19] are not equal : counts wrong: [ 13, 32 ] |
| testReadLoadBalancing(3)@/data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/jstests/slowNightly/replReads.js:108 |
| failed to load: /data/buildslaves/Linux_RHEL_64bit_Nightly/mongo/jstests/slowNightly/replReads.js |
2012-08-09 08:18:08 EDT | m29000| Thu Aug 9 08:18:06 got signal 15 (Terminated), will terminate after current cmd ends |
| m29000| Thu Aug 9 08:18:06 [interruptThread] now exiting |
| m29000| Thu Aug 9 08:18:06 dbexit: |
| m29000| Thu Aug 9 08:18:06 [interruptThread] closing listening socket: 31 |
| m29000| Thu Aug 9 08:18:06 [interruptThread] closing listening socket: 32 |
| m29000| Thu Aug 9 08:18:06 [interruptThread] closing listening socket: 33 |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: going to close listening sockets... |
| m29000| Thu Aug 9 08:18:06 [interruptThread] removing socket file: /tmp/mongodb-29000.sock |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: going to close sockets... |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: going to flush diaglog... |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: lock for final commit... |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: waiting for fs preallocator... |
| m29000| Thu Aug 9 08:18:06 [interruptThread] shutdown: final commit... |
| m29000| Thu Aug 9 08:18:08 [interruptThread] closeAllFiles() finished |
| m29000| Thu Aug 9 08:18:08 [interruptThread] journalCleanup... |
| m29000| Thu Aug 9 08:18:08 [interruptThread] removeJournalFiles |
| m29000| Thu Aug 9 08:18:08 [interruptThread] shutdown: closing all files... |
| m29000| Thu Aug 9 08:18:08 [interruptThread] shutdown: removing fs lock... |
| m29000| Thu Aug 9 08:18:08 dbexit: really exiting now |
| m30999| Thu Aug 9 08:18:08 [mongosMain] dbexit: received signal 15 rc:0 received signal 15 |
| m31100| Thu Aug 9 08:18:08 [conn42] end connection 10.76.211.188:45845 (55 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn58] end connection 10.76.211.188:45884 (54 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn61] end connection 10.76.211.188:45894 (53 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn67] end connection 10.76.211.188:45912 (52 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn6] end connection 10.76.211.188:36624 (17 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn49] end connection 10.76.211.188:45872 (50 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn52] end connection 10.76.211.188:45877 (51 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn25] end connection 10.76.211.188:45776 (49 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn76] end connection 10.76.211.188:45939 (47 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn77] end connection 10.76.211.188:45942 (49 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn27] end connection 10.76.211.188:45800 (46 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn28] end connection 10.76.211.188:45803 (44 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn74] end connection 10.76.211.188:45933 (43 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn29] end connection 10.76.211.188:45806 (42 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn73] end connection 10.76.211.188:45930 (41 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn75] end connection 10.76.211.188:45936 (45 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn30] end connection 10.76.211.188:45809 (40 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn31] end connection 10.76.211.188:45812 (38 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn71] end connection 10.76.211.188:45924 (37 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn32] end connection 10.76.211.188:45815 (36 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn72] end connection 10.76.211.188:45927 (39 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn33] end connection 10.76.211.188:45818 (34 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn69] end connection 10.76.211.188:45918 (33 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn34] end connection 10.76.211.188:45821 (32 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn68] end connection 10.76.211.188:45915 (31 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn35] end connection 10.76.211.188:45824 (30 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn70] end connection 10.76.211.188:45921 (35 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn36] end connection 10.76.211.188:45827 (29 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn37] end connection 10.76.211.188:45830 (28 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn65] end connection 10.76.211.188:45906 (27 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn38] end connection 10.76.211.188:45833 (26 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn64] end connection 10.76.211.188:45903 (25 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn66] end connection 10.76.211.188:45909 (29 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn39] end connection 10.76.211.188:45836 (24 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn40] end connection 10.76.211.188:45839 (22 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn62] end connection 10.76.211.188:45897 (21 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn41] end connection 10.76.211.188:45842 (20 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn63] end connection 10.76.211.188:45900 (23 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn43] end connection 10.76.211.188:45848 (18 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn59] end connection 10.76.211.188:45888 (17 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn44] end connection 10.76.211.188:45851 (16 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn45] end connection 10.76.211.188:45854 (15 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn53] end connection 10.76.211.188:45878 (14 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn60] end connection 10.76.211.188:45891 (19 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn42] end connection 10.76.211.188:47854 (37 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn11] end connection 10.76.211.188:47712 (36 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn41] end connection 10.76.211.188:47851 (35 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn40] end connection 10.76.211.188:47848 (34 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn43] end connection 10.76.211.188:47857 (38 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn12] end connection 10.76.211.188:47718 (33 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn38] end connection 10.76.211.188:47842 (31 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn13] end connection 10.76.211.188:47724 (30 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn37] end connection 10.76.211.188:47839 (29 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn36] end connection 10.76.211.188:47836 (28 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn39] end connection 10.76.211.188:47845 (32 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn14] end connection 10.76.211.188:47730 (27 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn34] end connection 10.76.211.188:47830 (25 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn15] end connection 10.76.211.188:47736 (25 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn33] end connection 10.76.211.188:47827 (23 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn32] end connection 10.76.211.188:47824 (22 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn35] end connection 10.76.211.188:47833 (26 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn16] end connection 10.76.211.188:47742 (21 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn30] end connection 10.76.211.188:47818 (19 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn17] end connection 10.76.211.188:47748 (18 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn29] end connection 10.76.211.188:47815 (17 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn31] end connection 10.76.211.188:47821 (20 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn18] end connection 10.76.211.188:47754 (15 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn27] end connection 10.76.211.188:47809 (14 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn26] end connection 10.76.211.188:47806 (13 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn19] end connection 10.76.211.188:47760 (12 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn25] end connection 10.76.211.188:47803 (11 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn28] end connection 10.76.211.188:47812 (16 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn21] end connection 10.76.211.188:47772 (9 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn20] end connection 10.76.211.188:47766 (9 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn11] end connection 10.76.211.188:36671 (16 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn12] end connection 10.76.211.188:36675 (15 connections now open) |
| m31102| Thu Aug 9 08:18:08 [conn24] end connection 10.76.211.188:47800 (10 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn13] end connection 10.76.211.188:36681 (14 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn14] end connection 10.76.211.188:36687 (13 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn15] end connection 10.76.211.188:36693 (12 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn16] end connection 10.76.211.188:36699 (11 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn17] end connection 10.76.211.188:36705 (10 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn18] end connection 10.76.211.188:36711 (9 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn19] end connection 10.76.211.188:36717 (8 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn20] end connection 10.76.211.188:36723 (7 connections now open) |
| m31100| Thu Aug 9 08:18:08 [conn46] end connection 10.76.211.188:45857 (13 connections now open) |
| m31101| Thu Aug 9 08:18:08 [conn21] end connection 10.76.211.188:36729 (6 connections now open) |
| m31100| Thu Aug 9 08:18:09 got signal 15 (Terminated), will terminate after current cmd ends |
| m31100| Thu Aug 9 08:18:09 [interruptThread] now exiting |
| m31100| Thu Aug 9 08:18:09 dbexit: |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: going to close listening sockets... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] closing listening socket: 15 |
| m31100| Thu Aug 9 08:18:09 [interruptThread] closing listening socket: 16 |
| m31102| Thu Aug 9 08:18:08 [conn7] end connection 10.76.211.188:47685 (38 connections now open) |
| m31100| Thu Aug 9 08:18:09 [interruptThread] closing listening socket: 17 |
| m31100| Thu Aug 9 08:18:09 [interruptThread] removing socket file: /tmp/mongodb-31100.sock |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: going to close sockets... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: going to flush diaglog... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: lock for final commit... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: waiting for fs preallocator... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: final commit... |
| m31102| Thu Aug 9 08:18:09 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m31102| Thu Aug 9 08:18:09 [conn22] end connection 10.76.211.188:47774 (6 connections now open) |
| m31101| Thu Aug 9 08:18:09 [conn23] end connection 10.76.211.188:36739 (5 connections now open) |
| m31102| Thu Aug 9 08:18:09 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m31101| Thu Aug 9 08:18:09 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: closing all files... |
| m31100| Thu Aug 9 08:18:09 [interruptThread] closeAllFiles() finished |
| m31100| Thu Aug 9 08:18:09 [interruptThread] journalCleanup... |
| m31101| Thu Aug 9 08:18:09 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: bs-rhel-57-64-2:31100 |
| m31100| Thu Aug 9 08:18:09 [interruptThread] removeJournalFiles |
| m31100| Thu Aug 9 08:18:09 [interruptThread] shutdown: removing fs lock... |
| m31100| Thu Aug 9 08:18:09 dbexit: really exiting now |
| m31101| Thu Aug 9 08:18:10 [rsHealthPoll] DBClientCursor::init call() failed |
| m31101| Thu Aug 9 08:18:10 [rsHealthPoll] replSet info bs-rhel-57-64-2:31100 is down (or slow to respond): DBClientBase::findN: transport error: bs-rhel-57-64-2:31100 ns: admin.$cmd query: { replSetHeartbeat: "replReads-rs0", v: 2, pv: 1, checkEmpty: false, from: "bs-rhel-57-64-2:31101", $auth: {} } |
| m31101| Thu Aug 9 08:18:10 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state DOWN |
| m31101| Thu Aug 9 08:18:10 got signal 15 (Terminated), will terminate after current cmd ends |
| m31101| Thu Aug 9 08:18:10 [interruptThread] now exiting |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: going to close listening sockets... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] closing listening socket: 18 |
| m31101| Thu Aug 9 08:18:10 [interruptThread] closing listening socket: 19 |
| m31101| Thu Aug 9 08:18:10 [interruptThread] closing listening socket: 20 |
| m31101| Thu Aug 9 08:18:10 [interruptThread] removing socket file: /tmp/mongodb-31101.sock |
| m31101| Thu Aug 9 08:18:10 dbexit: |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: going to close sockets... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: going to flush diaglog... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: lock for final commit... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: final commit... |
| m31101| Thu Aug 9 08:18:10 [conn1] end connection 10.76.211.188:36530 (4 connections now open) |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: waiting for fs preallocator... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: closing all files... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] closeAllFiles() finished |
| m31102| Thu Aug 9 08:18:10 [conn23] end connection 10.76.211.188:47777 (5 connections now open) |
| m31101| Thu Aug 9 08:18:10 [interruptThread] journalCleanup... |
| m31101| Thu Aug 9 08:18:10 [interruptThread] removeJournalFiles |
| m31101| Thu Aug 9 08:18:10 [interruptThread] shutdown: removing fs lock... |
| m31101| Thu Aug 9 08:18:10 dbexit: really exiting now |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] DBClientCursor::init call() failed |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] DBClientCursor::init call() failed |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] replSet info bs-rhel-57-64-2:31101 is down (or slow to respond): DBClientBase::findN: transport error: bs-rhel-57-64-2:31101 ns: admin.$cmd query: { replSetHeartbeat: "replReads-rs0", v: 2, pv: 1, checkEmpty: false, from: "bs-rhel-57-64-2:31102", $auth: {} } |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] replSet member bs-rhel-57-64-2:31101 is now in state DOWN |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] replSet info bs-rhel-57-64-2:31100 is down (or slow to respond): DBClientBase::findN: transport error: bs-rhel-57-64-2:31100 ns: admin.$cmd query: { replSetHeartbeat: "replReads-rs0", v: 2, pv: 1, checkEmpty: false, from: "bs-rhel-57-64-2:31102", $auth: {} } |
| m31102| Thu Aug 9 08:18:11 [rsHealthPoll] replSet member bs-rhel-57-64-2:31100 is now in state DOWN |
| m31102| Thu Aug 9 08:18:11 [rsMgr] replSet can't see a majority, will not try to elect self |
| m31102| Thu Aug 9 08:18:11 [interruptThread] now exiting |
| m31102| Thu Aug 9 08:18:11 dbexit: |
| m31102| Thu Aug 9 08:18:11 [interruptThread] shutdown: going to close listening sockets... |
| m31102| Thu Aug 9 08:18:11 got signal 15 (Terminated), will terminate after current cmd ends |
| m31102| Thu Aug 9 08:18:11 [interruptThread] closing listening socket: 21 |
| m31102| Thu Aug 9 08:18:11 [interruptThread] closing listening socket: 22 |
| m31102| Thu Aug 9 08:18:11 [interruptThread] closing listening socket: 23 |
| m31102| Thu Aug 9 08:18:11 [interruptThread] removing socket file: /tmp/mongodb-31102.sock |
| m31102| Thu Aug 9 08:18:11 [interruptThread] shutdown: going to flush diaglog... |
2012-08-09 08:18:12 EDT | Thu Aug 9 08:18:12 [conn33] end connection 127.0.0.1:47267 (0 connections now open) |
| m31102| Thu Aug 9 08:18:11 [interruptThread] shutdown: goi |
| Thu Aug 9 08:18:12 [interruptThread] now exiting |
| Thu Aug 9 08:18:12 dbexit: |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: going to close listening sockets... |
| Thu Aug 9 08:18:12 [interruptThread] closing listening socket: 8 |
| Thu Aug 9 08:18:12 [interruptThread] closing listening socket: 11 |
| Thu Aug 9 08:18:12 [interruptThread] closing listening socket: 12 |
| Thu Aug 9 08:18:12 [interruptThread] removing socket file: /tmp/mongodb-27999.sock |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: going to flush diaglog... |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: going to close sockets... |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: waiting for fs preallocator... |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: lock for final commit... |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: final commit... |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: closing all files... |
| Thu Aug 9 08:18:12 [interruptThread] closeAllFiles() finished |
| Thu Aug 9 08:18:12 [interruptThread] journalCleanup... |
| Thu Aug 9 08:18:12 [interruptThread] removeJournalFiles |
| Thu Aug 9 08:18:12 [interruptThread] shutdown: removing fs lock... |
| Thu Aug 9 08:18:12 dbexit: really exiting now |
| Thu Aug 9 08:18:12 got signal 15 (Terminated), will terminate after current cmd ends |