Home > Linux 64-bit DEBUG #1409 > repl_monitor_stress.js

Plain Text
2012-08-09 07:45:49 EDT	
Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:48700 #34 (12 connections now open)
MongoDB shell version: 2.2.0-rc1-pre-
connecting to: 127.0.0.1:27999/test
Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:48705 #35 (13 connections now open)
null
ReplSetTest Starting Set
ReplSetTest n is : 0
ReplSetTest n: 0 ports: [ 31100, 31101, 31102, 31103, 31104 ]	31100 number
Replica set test!
{
"oplogSize" : 10,
"keyFile" : undefined,
"port" : 31100,
"noprealloc" : "",
"smallfiles" : "",
"rest" : "",
"replSet" : "test-rs0",
"dbpath" : "$set-$node",
"useHostName" : true,
"noJournalPrealloc" : undefined,
"pathOpts" : {
"testName" : "test",
"shard" : 0,
"node" : 0,
"set" : "test-rs0"
"useHostname" : true,
"restart" : undefined
},
ReplSetTest Starting....
Resetting db path '/data/db/test-rs0-0'
}
Thu Aug 9 07:45:49 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --oplogSize 10 --port 31100 --noprealloc --smallfiles --rest --replSet test-rs0 --dbpath /data/db/test-rs0-0
m31100| Thu Aug 9 07:45:49 [initandlisten] MongoDB starting : pid=7212 port=31100 dbpath=/data/db/test-rs0-0 64-bit host=SERVER04
m31100| Thu Aug 9 07:45:49 [initandlisten] _DEBUG build (which is slower)
m31100| Thu Aug 9 07:45:49 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m31100| Thu Aug 9 07:45:49 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m31100| Thu Aug 9 07:45:49 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m31100| Thu Aug 9 07:45:49 [initandlisten] options: { dbpath: "/data/db/test-rs0-0", noprealloc: true, oplogSize: 10, port: 31100, replSet: "test-rs0", rest: true, smallfiles: true }
m31100| Thu Aug 9 07:45:49 [initandlisten] journal dir=/data/db/test-rs0-0/journal
m31100| Thu Aug 9 07:45:49 [initandlisten] recover : no journal files present, no recovery needed
m31100| note: noprealloc may hurt performance in many applications
m31100| Thu Aug 9 07:45:49 [initandlisten] waiting for connections on port 31100
m31100| Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:45096 #1 (1 connection now open)
m31100| Thu Aug 9 07:45:49 [conn1] _DEBUG ReadContext db wasn't open, will try to open local.system.replset
m31100| Thu Aug 9 07:45:49 [conn1] opening db: local
m31100| Thu Aug 9 07:45:49 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG)
m31100| Thu Aug 9 07:45:49 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done
m31100| Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:45097 #2 (2 connections now open)
m31100| Thu Aug 9 07:45:49 [websvr] admin web console waiting for connections on port 32100
ReplSetTest n is : 1
ReplSetTest n: 1 ports: [ 31100, 31101, 31102, 31103, 31104 ]	31101 number
[ connection to SERVER04:31100 ]
"useHostName" : true,
"oplogSize" : 10,
"keyFile" : undefined,
"port" : 31101,
"noprealloc" : "",
"smallfiles" : "",
"rest" : "",
"replSet" : "test-rs0",
"dbpath" : "$set-$node",
{
"noJournalPrealloc" : undefined,
"pathOpts" : {
"testName" : "test",
"shard" : 0,
"node" : 1,
"set" : "test-rs0"
"useHostname" : true,
"restart" : undefined
},
ReplSetTest Starting....
Resetting db path '/data/db/test-rs0-1'
}
Thu Aug 9 07:45:49 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --oplogSize 10 --port 31101 --noprealloc --smallfiles --rest --replSet test-rs0 --dbpath /data/db/test-rs0-1
m31101| Thu Aug 9 07:45:49 [initandlisten] MongoDB starting : pid=7261 port=31101 dbpath=/data/db/test-rs0-1 64-bit host=SERVER04
m31101| note: noprealloc may hurt performance in many applications
m31101| Thu Aug 9 07:45:49 [initandlisten] _DEBUG build (which is slower)
m31101| Thu Aug 9 07:45:49 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m31101| Thu Aug 9 07:45:49 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m31101| Thu Aug 9 07:45:49 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m31101| Thu Aug 9 07:45:49 [initandlisten] journal dir=/data/db/test-rs0-1/journal
m31101| Thu Aug 9 07:45:49 [initandlisten] options: { dbpath: "/data/db/test-rs0-1", noprealloc: true, oplogSize: 10, port: 31101, replSet: "test-rs0", rest: true, smallfiles: true }
m31101| Thu Aug 9 07:45:49 [initandlisten] recover : no journal files present, no recovery needed
m31101| Thu Aug 9 07:45:49 [initandlisten] waiting for connections on port 31101
m31101| Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:42678 #1 (1 connection now open)
m31101| Thu Aug 9 07:45:49 [conn1] _DEBUG ReadContext db wasn't open, will try to open local.system.replset
m31101| Thu Aug 9 07:45:49 [conn1] opening db: local
m31101| Thu Aug 9 07:45:49 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG)
m31101| Thu Aug 9 07:45:49 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done
m31101| Thu Aug 9 07:45:49 [initandlisten] connection accepted from 127.0.0.1:42679 #2 (2 connections now open)
m31101| Thu Aug 9 07:45:49 [websvr] admin web console waiting for connections on port 32101
ReplSetTest n is : 2
ReplSetTest n: 2 ports: [ 31100, 31101, 31102, 31103, 31104 ]	31102 number
[ connection to SERVER04:31100, connection to SERVER04:31101 ]
"useHostName" : true,
"oplogSize" : 10,
"keyFile" : undefined,
"port" : 31102,
"noprealloc" : "",
"smallfiles" : "",
"rest" : "",
"replSet" : "test-rs0",
"dbpath" : "$set-$node",
"useHostname" : true,
"noJournalPrealloc" : undefined,
"pathOpts" : {
"testName" : "test",
"shard" : 0,
"node" : 2,
"set" : "test-rs0"
},
"restart" : undefined
{
ReplSetTest Starting....
Resetting db path '/data/db/test-rs0-2'
}
Thu Aug 9 07:45:49 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --oplogSize 10 --port 31102 --noprealloc --smallfiles --rest --replSet test-rs0 --dbpath /data/db/test-rs0-2
m31102| Thu Aug 9 07:45:50 [initandlisten] MongoDB starting : pid=7310 port=31102 dbpath=/data/db/test-rs0-2 64-bit host=SERVER04
m31102| Thu Aug 9 07:45:50 [initandlisten] _DEBUG build (which is slower)
m31102| Thu Aug 9 07:45:50 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m31102| Thu Aug 9 07:45:50 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m31102| Thu Aug 9 07:45:50 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m31102| Thu Aug 9 07:45:50 [initandlisten] options: { dbpath: "/data/db/test-rs0-2", noprealloc: true, oplogSize: 10, port: 31102, replSet: "test-rs0", rest: true, smallfiles: true }
m31102| Thu Aug 9 07:45:50 [initandlisten] journal dir=/data/db/test-rs0-2/journal
m31102| Thu Aug 9 07:45:50 [initandlisten] recover : no journal files present, no recovery needed
m31102| Thu Aug 9 07:45:50 [initandlisten] waiting for connections on port 31102
m31102| Thu Aug 9 07:45:50 [websvr] admin web console waiting for connections on port 32102
m31102| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:47983 #1 (1 connection now open)
m31102| Thu Aug 9 07:45:50 [conn1] _DEBUG ReadContext db wasn't open, will try to open local.system.replset
m31102| note: noprealloc may hurt performance in many applications
m31102| Thu Aug 9 07:45:50 [conn1] opening db: local
m31102| Thu Aug 9 07:45:50 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG)
m31102| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:47984 #2 (2 connections now open)
m31102| Thu Aug 9 07:45:50 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done
connection to SERVER04:31100,
connection to SERVER04:31101,
connection to SERVER04:31102
[
ReplSetTest n is : 3
ReplSetTest n: 3 ports: [ 31100, 31101, 31102, 31103, 31104 ]	31103 number
]
"useHostName" : true,
"oplogSize" : 10,
"keyFile" : undefined,
"port" : 31103,
"noprealloc" : "",
"smallfiles" : "",
"rest" : "",
"replSet" : "test-rs0",
"dbpath" : "$set-$node",
"useHostname" : true,
"noJournalPrealloc" : undefined,
"pathOpts" : {
"testName" : "test",
"shard" : 0,
"node" : 3,
"set" : "test-rs0"
},
"restart" : undefined
{
}
ReplSetTest Starting....
Resetting db path '/data/db/test-rs0-3'
Thu Aug 9 07:45:50 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --oplogSize 10 --port 31103 --noprealloc --smallfiles --rest --replSet test-rs0 --dbpath /data/db/test-rs0-3
m31103| Thu Aug 9 07:45:50 [initandlisten] MongoDB starting : pid=7359 port=31103 dbpath=/data/db/test-rs0-3 64-bit host=SERVER04
m31103| Thu Aug 9 07:45:50 [initandlisten] _DEBUG build (which is slower)
m31103| note: noprealloc may hurt performance in many applications
m31103| Thu Aug 9 07:45:50 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m31103| Thu Aug 9 07:45:50 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m31103| Thu Aug 9 07:45:50 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m31103| Thu Aug 9 07:45:50 [initandlisten] journal dir=/data/db/test-rs0-3/journal
m31103| Thu Aug 9 07:45:50 [initandlisten] options: { dbpath: "/data/db/test-rs0-3", noprealloc: true, oplogSize: 10, port: 31103, replSet: "test-rs0", rest: true, smallfiles: true }
m31103| Thu Aug 9 07:45:50 [initandlisten] recover : no journal files present, no recovery needed
m31103| Thu Aug 9 07:45:50 [initandlisten] waiting for connections on port 31103
m31103| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:51907 #1 (1 connection now open)
m31103| Thu Aug 9 07:45:50 [conn1] _DEBUG ReadContext db wasn't open, will try to open local.system.replset
m31103| Thu Aug 9 07:45:50 [conn1] opening db: local
m31103| Thu Aug 9 07:45:50 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG)
m31103| Thu Aug 9 07:45:50 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done
m31103| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:51908 #2 (2 connections now open)
m31103| Thu Aug 9 07:45:50 [websvr] admin web console waiting for connections on port 32103
connection to SERVER04:31100,
connection to SERVER04:31101,
connection to SERVER04:31102,
connection to SERVER04:31103
[
ReplSetTest n is : 4
ReplSetTest n: 4 ports: [ 31100, 31101, 31102, 31103, 31104 ]	31104 number
]
"useHostName" : true,
"oplogSize" : 10,
"keyFile" : undefined,
"port" : 31104,
"noprealloc" : "",
"smallfiles" : "",
"rest" : "",
"replSet" : "test-rs0",
"dbpath" : "$set-$node",
"useHostname" : true,
"noJournalPrealloc" : undefined,
{
"testName" : "test",
"shard" : 0,
"node" : 4,
"set" : "test-rs0"
"pathOpts" : {
"restart" : undefined
},
ReplSetTest Starting....
Resetting db path '/data/db/test-rs0-4'
Thu Aug 9 07:45:50 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --oplogSize 10 --port 31104 --noprealloc --smallfiles --rest --replSet test-rs0 --dbpath /data/db/test-rs0-4
}
m31104| Thu Aug 9 07:45:50 [initandlisten] MongoDB starting : pid=7408 port=31104 dbpath=/data/db/test-rs0-4 64-bit host=SERVER04
m31104| Thu Aug 9 07:45:50 [initandlisten] _DEBUG build (which is slower)
m31104| Thu Aug 9 07:45:50 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m31104| Thu Aug 9 07:45:50 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m31104| Thu Aug 9 07:45:50 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m31104| Thu Aug 9 07:45:50 [initandlisten] options: { dbpath: "/data/db/test-rs0-4", noprealloc: true, oplogSize: 10, port: 31104, replSet: "test-rs0", rest: true, smallfiles: true }
m31104| Thu Aug 9 07:45:50 [initandlisten] journal dir=/data/db/test-rs0-4/journal
m31104| Thu Aug 9 07:45:50 [initandlisten] recover : no journal files present, no recovery needed
m31104| Thu Aug 9 07:45:50 [initandlisten] waiting for connections on port 31104
m31104| note: noprealloc may hurt performance in many applications
m31104| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:38352 #1 (1 connection now open)
m31104| Thu Aug 9 07:45:50 [conn1] _DEBUG ReadContext db wasn't open, will try to open local.system.replset
m31104| Thu Aug 9 07:45:50 [conn1] opening db: local
m31104| Thu Aug 9 07:45:50 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG)
m31104| Thu Aug 9 07:45:50 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done
m31104| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:38353 #2 (2 connections now open)
m31104| Thu Aug 9 07:45:50 [websvr] admin web console waiting for connections on port 32104
connection to SERVER04:31100,
connection to SERVER04:31101,
connection to SERVER04:31102,
connection to SERVER04:31103,
connection to SERVER04:31104
[
]
"replSetInitiate" : {
"_id" : "test-rs0",
"members" : [
{
"_id" : 0,
"host" : "SERVER04:31100"
},
{
"_id" : 1,
"host" : "SERVER04:31101"
},
{
"_id" : 2,
"host" : "SERVER04:31102"
},
{
"_id" : 3,
"host" : "SERVER04:31103"
},
{
"_id" : 4,
"host" : "SERVER04:31104"
}
]
}
{
}
m31100| Thu Aug 9 07:45:50 [conn2] replSet replSetInitiate admin command received from client
m31100| Thu Aug 9 07:45:50 [conn2] replSet replSetInitiate config object parses ok, 5 members specified
m31101| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:42691 #3 (3 connections now open)
m31102| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:47994 #3 (3 connections now open)
m31103| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:51916 #3 (3 connections now open)
m31100| Thu Aug 9 07:45:50 [conn2] replSet replSetInitiate all members seem up
m31100| Thu Aug 9 07:45:50 [conn2] ******
m31100| Thu Aug 9 07:45:50 [conn2] creating replication oplog of size: 10MB...
m31100| Thu Aug 9 07:45:50 [FileAllocator] allocating new datafile /data/db/test-rs0-0/local.ns, filling with zeroes...
m31100| Thu Aug 9 07:45:50 [FileAllocator] creating directory /data/db/test-rs0-0/_tmp
m31100| Thu Aug 9 07:45:50 [FileAllocator] done allocating datafile /data/db/test-rs0-0/local.ns, size: 16MB, took 0 secs
m31100| Thu Aug 9 07:45:50 [FileAllocator] allocating new datafile /data/db/test-rs0-0/local.0, filling with zeroes...
m31104| Thu Aug 9 07:45:50 [initandlisten] connection accepted from 127.0.0.1:38357 #3 (3 connections now open)
m31100| Thu Aug 9 07:45:50 [FileAllocator] done allocating datafile /data/db/test-rs0-0/local.0, size: 16MB, took 0 secs
m31100| Thu Aug 9 07:45:50 [conn2] ******
m31100| Thu Aug 9 07:45:50 [conn2] datafileheader::init initializing /data/db/test-rs0-0/local.0 n:0
m31100| Thu Aug 9 07:45:50 [conn2] replSet info saving a newer config version to local.system.replset
m31100| Thu Aug 9 07:45:50 [conn2] replSet replSetInitiate config now saved locally. Should come online in about a minute.
m31100| Thu Aug 9 07:45:50 [conn2] replSet saveConfigLocally done
"info" : "Config now saved locally. Should come online in about a minute.",
"ok" : 1
{
}
2012-08-09 07:46:00 EDT	
m31100| Thu Aug 9 07:45:59 [rsStart] replSet load config ok from self
m31100| Thu Aug 9 07:45:59 [rsStart] replSet I am SERVER04:31100
m31100| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31103
m31100| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31102
m31100| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31101
m31100| Thu Aug 9 07:45:59 [rsStart] replSet STARTUP2
m31100| Thu Aug 9 07:45:59 [rsHealthPoll] replSet member SERVER04:31104 is up
m31100| Thu Aug 9 07:45:59 [rsHealthPoll] replSet member SERVER04:31103 is up
m31100| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31104
m31100| Thu Aug 9 07:45:59 [rsStart] thread rsStart stack usage was 15400 bytes, which is the most so far
m31102| Thu Aug 9 07:45:59 [conn3] end connection 127.0.0.1:47994 (2 connections now open)
m31102| Thu Aug 9 07:45:59 [conn3] thread conn3 stack usage was 6184 bytes, which is the most so far
m31100| Thu Aug 9 07:45:59 [rsHealthPoll] replSet member SERVER04:31101 is up
m31100| Thu Aug 9 07:45:59 [rsHealthPoll] replSet member SERVER04:31102 is up
m31100| Thu Aug 9 07:45:59 [rsSync] replSet SECONDARY
m31101| Thu Aug 9 07:45:59 [rsStart] trying to contact SERVER04:31100
m31100| Thu Aug 9 07:45:59 [initandlisten] connection accepted from 127.0.0.1:45117 #3 (3 connections now open)
m31101| Thu Aug 9 07:45:59 [rsStart] replSet load config ok from SERVER04:31100
m31102| Thu Aug 9 07:45:59 [initandlisten] connection accepted from 127.0.0.1:47997 #4 (3 connections now open)
m31101| Thu Aug 9 07:45:59 [rsStart] replSet I am SERVER04:31101
m31101| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31103
m31101| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31102
m31101| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31100
m31101| Thu Aug 9 07:45:59 [rsStart] replSet got config version 1 from a remote, saving locally
m31101| Thu Aug 9 07:45:59 [rsStart] replSet info saving a newer config version to local.system.replset
m31101| Thu Aug 9 07:45:59 [FileAllocator] allocating new datafile /data/db/test-rs0-1/local.ns, filling with zeroes...
m31101| Thu Aug 9 07:45:59 [FileAllocator] creating directory /data/db/test-rs0-1/_tmp
m31101| Thu Aug 9 07:45:59 [FileAllocator] done allocating datafile /data/db/test-rs0-1/local.ns, size: 16MB, took 0 secs
m31101| Thu Aug 9 07:45:59 [FileAllocator] allocating new datafile /data/db/test-rs0-1/local.0, filling with zeroes...
m31101| Thu Aug 9 07:45:59 [FileAllocator] done allocating datafile /data/db/test-rs0-1/local.0, size: 16MB, took 0 secs
m31101| Thu Aug 9 07:45:59 [rsStart] datafileheader::init initializing /data/db/test-rs0-1/local.0 n:0
m31101| Thu Aug 9 07:45:59 [rsStart] replSet saveConfigLocally done
m31101| Thu Aug 9 07:45:59 [rsStart] replSet STARTUP2
m31101| Thu Aug 9 07:45:59 [rsStart] starting rsHealthPoll for SERVER04:31104
m31101| Thu Aug 9 07:45:59 [rsSync] ******
m31101| Thu Aug 9 07:45:59 [rsStart] thread rsStart stack usage was 15400 bytes, which is the most so far
m31101| Thu Aug 9 07:45:59 [rsSync] ******
m31101| Thu Aug 9 07:45:59 [rsSync] creating replication oplog of size: 10MB...
m31101| Thu Aug 9 07:45:59 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync
m31101| Thu Aug 9 07:45:59 [rsSync] replSet initial sync pending
m31102| Thu Aug 9 07:46:00 [rsStart] trying to contact SERVER04:31100
m31100| Thu Aug 9 07:46:00 [initandlisten] connection accepted from 127.0.0.1:45118 #4 (4 connections now open)
m31102| Thu Aug 9 07:46:00 [rsStart] replSet I am SERVER04:31102
m31102| Thu Aug 9 07:46:00 [rsStart] replSet load config ok from SERVER04:31100
m31102| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31103
m31102| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31101
m31102| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31104
m31102| Thu Aug 9 07:46:00 [rsStart] replSet got config version 1 from a remote, saving locally
m31102| Thu Aug 9 07:46:00 [rsStart] replSet info saving a newer config version to local.system.replset
m31102| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-2/local.ns, filling with zeroes...
m31102| Thu Aug 9 07:46:00 [FileAllocator] creating directory /data/db/test-rs0-2/_tmp
m31102| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-2/local.ns, size: 16MB, took 0 secs
m31102| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-2/local.0, filling with zeroes...
m31102| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-2/local.0, size: 16MB, took 0 secs
m31102| Thu Aug 9 07:46:00 [rsStart] datafileheader::init initializing /data/db/test-rs0-2/local.0 n:0
m31102| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31100
m31102| Thu Aug 9 07:46:00 [rsStart] replSet STARTUP2
m31102| Thu Aug 9 07:46:00 [rsStart] replSet saveConfigLocally done
m31102| Thu Aug 9 07:46:00 [rsStart] thread rsStart stack usage was 15400 bytes, which is the most so far
m31102| Thu Aug 9 07:46:00 [rsSync] ******
m31102| Thu Aug 9 07:46:00 [rsSync] ******
m31102| Thu Aug 9 07:46:00 [rsSync] creating replication oplog of size: 10MB...
m31102| Thu Aug 9 07:46:00 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync
m31102| Thu Aug 9 07:46:00 [rsSync] replSet initial sync pending
m31100| Thu Aug 9 07:46:00 [initandlisten] connection accepted from 127.0.0.1:45121 #5 (5 connections now open)
m31103| Thu Aug 9 07:46:00 [rsStart] replSet load config ok from SERVER04:31100
m31103| Thu Aug 9 07:46:00 [rsStart] replSet I am SERVER04:31103
m31103| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31104
m31103| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31102
m31103| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31101
m31103| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31100
m31103| Thu Aug 9 07:46:00 [rsStart] replSet got config version 1 from a remote, saving locally
m31103| Thu Aug 9 07:46:00 [rsStart] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-3/local.ns, filling with zeroes...
m31103| Thu Aug 9 07:46:00 [FileAllocator] creating directory /data/db/test-rs0-3/_tmp
m31103| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-3/local.ns, size: 16MB, took 0 secs
m31103| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-3/local.0, filling with zeroes...
m31103| Thu Aug 9 07:46:00 [rsStart] trying to contact SERVER04:31100
m31103| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-3/local.0, size: 16MB, took 0 secs
m31103| Thu Aug 9 07:46:00 [rsStart] datafileheader::init initializing /data/db/test-rs0-3/local.0 n:0
m31103| Thu Aug 9 07:46:00 [rsStart] replSet STARTUP2
m31103| Thu Aug 9 07:46:00 [rsStart] replSet saveConfigLocally done
m31103| Thu Aug 9 07:46:00 [rsSync] ******
m31103| Thu Aug 9 07:46:00 [rsStart] thread rsStart stack usage was 15400 bytes, which is the most so far
m31103| Thu Aug 9 07:46:00 [rsSync] ******
m31103| Thu Aug 9 07:46:00 [rsSync] creating replication oplog of size: 10MB...
m31103| Thu Aug 9 07:46:00 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync
m31103| Thu Aug 9 07:46:00 [rsSync] replSet initial sync pending
m31100| Thu Aug 9 07:46:00 [initandlisten] connection accepted from 127.0.0.1:45122 #6 (6 connections now open)
m31104| Thu Aug 9 07:46:00 [rsStart] replSet load config ok from SERVER04:31100
m31104| Thu Aug 9 07:46:00 [rsStart] replSet I am SERVER04:31104
m31104| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31103
m31104| Thu Aug 9 07:46:00 [rsStart] trying to contact SERVER04:31100
2012-08-09 07:46:02 EDT	
m31104| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31100
m31104| Thu Aug 9 07:46:00 [rsStart] replSet got config version 1 from a remote, saving locally
m31104| Thu Aug 9 07:46:00 [rsStart] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-4/local.ns, filling with zeroes...
m31104| Thu Aug 9 07:46:00 [FileAllocator] creating directory /data/db/test-rs0-4/_tmp
m31104| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-4/local.ns, size: 16MB, took 0 secs
m31104| Thu Aug 9 07:46:00 [FileAllocator] allocating new datafile /data/db/test-rs0-4/local.0, filling with zeroes...
m31104| Thu Aug 9 07:46:00 [FileAllocator] done allocating datafile /data/db/test-rs0-4/local.0, size: 16MB, took 0 secs
m31104| Thu Aug 9 07:46:00 [rsStart] datafileheader::init initializing /data/db/test-rs0-4/local.0 n:0
m31104| Thu Aug 9 07:46:00 [rsStart] replSet saveConfigLocally done
m31104| Thu Aug 9 07:46:00 [rsStart] starting rsHealthPoll for SERVER04:31101
m31104| Thu Aug 9 07:46:00 [rsStart] replSet STARTUP2
m31104| Thu Aug 9 07:46:00 [rsSync] ******
m31104| Thu Aug 9 07:46:00 [rsStart] thread rsStart stack usage was 15400 bytes, which is the most so far
m31104| Thu Aug 9 07:46:00 [rsSync] ******
m31104| Thu Aug 9 07:46:00 [rsSync] creating replication oplog of size: 10MB...
m31104| Thu Aug 9 07:46:00 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync
m31100| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31103 is now in state STARTUP2
m31100| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31104 is now in state STARTUP2
m31100| Thu Aug 9 07:46:01 [rsMgr] not electing self, SERVER04:31104 would veto
m31100| Thu Aug 9 07:46:01 [rsMgr] not electing self, SERVER04:31104 would veto
m31100| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31101 is now in state STARTUP2
m31100| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31102 is now in state STARTUP2
m31100| Thu Aug 9 07:46:01 [rsMgr] not electing self, SERVER04:31104 would veto
m31100| Thu Aug 9 07:46:01 [rsMgr] not electing self, SERVER04:31104 would veto
m31104| Thu Aug 9 07:46:00 [rsSync] replSet initial sync pending
m31102| Thu Aug 9 07:46:01 [initandlisten] connection accepted from 127.0.0.1:48005 #5 (4 connections now open)
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31100 is up
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31102| Thu Aug 9 07:46:01 [conn5] end connection 127.0.0.1:48005 (3 connections now open)
m31102| Thu Aug 9 07:46:01 [initandlisten] connection accepted from 127.0.0.1:48006 #6 (5 connections now open)
m31103| Thu Aug 9 07:46:01 [initandlisten] connection accepted from 127.0.0.1:51928 #4 (4 connections now open)
m31104| Thu Aug 9 07:46:01 [initandlisten] connection accepted from 127.0.0.1:38365 #4 (4 connections now open)
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31104 is now in state STARTUP2
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31102 is now in state STARTUP2
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31103 is up
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31103 is now in state STARTUP2
m31101| Thu Aug 9 07:46:01 [rsHealthPoll] replSet member SERVER04:31104 is up
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42707 #4 (4 connections now open)
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is up
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31103| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:51929 #5 (5 connections now open)
2012-08-09 07:46:07 EDT	
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42708 #5 (5 connections now open)
m31101| Thu Aug 9 07:46:02 [conn4] end connection 127.0.0.1:42707 (4 connections now open)
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31103 is now in state STARTUP2
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31103 is up
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is up
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is now in state STARTUP2
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31104 is up
m31102| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31104 is now in state STARTUP2
m31102| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:48014 #7 (5 connections now open)
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is up
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31104| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:38372 #5 (5 connections now open)
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42714 #6 (5 connections now open)
m31101| Thu Aug 9 07:46:02 [conn6] end connection 127.0.0.1:42714 (4 connections now open)
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31104 is up
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31104 is now in state STARTUP2
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42715 #7 (6 connections now open)
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31102 is up
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31102 is now in state STARTUP2
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is now in state STARTUP2
m31104| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:38376 #6 (6 connections now open)
m31103| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:51939 #6 (6 connections now open)
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31102| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:48019 #8 (6 connections now open)
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42718 #8 (6 connections now open)
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31100 is up
m31101| Thu Aug 9 07:46:02 [conn8] end connection 127.0.0.1:42718 (5 connections now open)
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31103 is now in state STARTUP2
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:46:02 [initandlisten] connection accepted from 127.0.0.1:42719 #9 (7 connections now open)
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31102 is now in state STARTUP2
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31101 is now in state STARTUP2
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet info electSelf 0
m31104| Thu Aug 9 07:46:02 [rsHealthPoll] replSet member SERVER04:31103 is up
m31104| Thu Aug 9 07:46:07 [conn3] replSet RECOVERING
m31104| Thu Aug 9 07:46:07 [conn3] replSet info voting yea for SERVER04:31100 (0)
m31103| Thu Aug 9 07:46:07 [conn3] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31100", whoid: 0, cfgver: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b') }
m31103| Thu Aug 9 07:46:07 [conn3] replSet RECOVERING
m31104| Thu Aug 9 07:46:07 [conn3] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31100", whoid: 0, cfgver: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b') }
m31102| Thu Aug 9 07:46:07 [conn4] replSet RECOVERING
m31101| Thu Aug 9 07:46:07 [conn3] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31100", whoid: 0, cfgver: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b') }
m31101| Thu Aug 9 07:46:07 [conn3] replSet RECOVERING
m31101| Thu Aug 9 07:46:07 [conn3] replSet info voting yea for SERVER04:31100 (0)
m31102| Thu Aug 9 07:46:07 [conn4] replSet info voting yea for SERVER04:31100 (0)
m31100| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31102 is now in state RECOVERING
m31102| Thu Aug 9 07:46:07 [conn4] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31100", whoid: 0, cfgver: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b') }
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b'), ok: 1.0 }
m31103| Thu Aug 9 07:46:07 [conn3] replSet info voting yea for SERVER04:31100 (0)
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b'), ok: 1.0 }
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b'), ok: 1.0 }
m31100| Thu Aug 9 07:46:07 [rsMgr] info PageFaultRetryableSection will not yield, already locked upon reaching
m31100| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31101 is now in state RECOVERING
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet PRIMARY
m31100| Thu Aug 9 07:46:07 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a2ff0cfd2cb49f09022b'), ok: 1.0 }
m31101| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31101| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31102 is now in state RECOVERING
m31101| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31103 is now in state RECOVERING
m31101| Thu Aug 9 07:46:07 [rsHealthPoll] replSet member SERVER04:31104 is now in state RECOVERING
m31102| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31102| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31101 is now in state RECOVERING
m31102| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31103 is now in state RECOVERING
m31102| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31104 is now in state RECOVERING
m31103| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31103| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31102 is now in state RECOVERING
m31103| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31101 is now in state RECOVERING
m31103| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31104 is now in state RECOVERING
m31104| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31104| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31103 is now in state RECOVERING
m31104| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31101 is now in state RECOVERING
m31100| Thu Aug 9 07:46:08 [conn2] opening db: admin
m31100| Thu Aug 9 07:46:08 [FileAllocator] allocating new datafile /data/db/test-rs0-0/admin.ns, filling with zeroes...
m31100| Thu Aug 9 07:46:08 [FileAllocator] done allocating datafile /data/db/test-rs0-0/admin.ns, size: 16MB, took 0 secs
m31100| Thu Aug 9 07:46:08 [FileAllocator] allocating new datafile /data/db/test-rs0-0/admin.0, filling with zeroes...
m31100| Thu Aug 9 07:46:08 [FileAllocator] done allocating datafile /data/db/test-rs0-0/admin.0, size: 16MB, took 0 secs
m31100| Thu Aug 9 07:46:08 [conn2] datafileheader::init initializing /data/db/test-rs0-0/admin.0 n:0
m31100| Thu Aug 9 07:46:08 [conn2] build index admin.foo { _id: 1 }
m31100| Thu Aug 9 07:46:08 [conn2] build index done. scanned 0 total records. 0 secs
m31104| Thu Aug 9 07:46:08 [rsHealthPoll] replSet member SERVER04:31102 is now in state RECOVERING
ReplSetTest Timestamp(1344512768000, 1)
ReplSetTest waiting for connection to SERVER04:31101 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31102 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31103 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31104 to have an oplog built.
2012-08-09 07:46:10 EDT	
m31100| Thu Aug 9 07:46:09 [rsHealthPoll] replSet member SERVER04:31103 is now in state RECOVERING
m31100| Thu Aug 9 07:46:09 [rsHealthPoll] replSet member SERVER04:31104 is now in state RECOVERING
ReplSetTest waiting for connection to SERVER04:31101 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31102 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31103 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31104 to have an oplog built.
2012-08-09 07:46:12 EDT	
ReplSetTest waiting for connection to SERVER04:31101 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31102 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31103 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31104 to have an oplog built.
2012-08-09 07:46:14 EDT	
m31103| Thu Aug 9 07:46:13 [conn3] end connection 127.0.0.1:51916 (5 connections now open)
m31103| Thu Aug 9 07:46:13 [initandlisten] connection accepted from 127.0.0.1:51949 #7 (7 connections now open)
ReplSetTest waiting for connection to SERVER04:31101 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31102 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31103 to have an oplog built.
ReplSetTest waiting for connection to SERVER04:31104 to have an oplog built.
2012-08-09 07:46:16 EDT	
m31101| Thu Aug 9 07:46:15 [conn3] end connection 127.0.0.1:42691 (5 connections now open)
m31101| Thu Aug 9 07:46:15 [initandlisten] connection accepted from 127.0.0.1:42729 #10 (7 connections now open)
m31103| Thu Aug 9 07:46:15 [conn4] end connection 127.0.0.1:51928 (5 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync pending
m31101| Thu Aug 9 07:46:15 [rsSync] replSet syncing to: SERVER04:31100
m31100| Thu Aug 9 07:46:15 [initandlisten] connection accepted from 127.0.0.1:45152 #7 (7 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] build index local.me { _id: 1 }
m31101| Thu Aug 9 07:46:15 [rsSync] build index done. scanned 0 total records. 0.001 secs
m31103| Thu Aug 9 07:46:15 [initandlisten] connection accepted from 127.0.0.1:51953 #8 (7 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] dropAllDatabasesExceptLocal 1
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync clone all databases
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync cloning db: admin
m31101| Thu Aug 9 07:46:15 [rsSync] opening db: admin
m31100| Thu Aug 9 07:46:15 [initandlisten] connection accepted from 127.0.0.1:45153 #8 (8 connections now open)
m31101| Thu Aug 9 07:46:15 [FileAllocator] allocating new datafile /data/db/test-rs0-1/admin.ns, filling with zeroes...
m31101| Thu Aug 9 07:46:15 [FileAllocator] done allocating datafile /data/db/test-rs0-1/admin.ns, size: 16MB, took 0 secs
m31101| Thu Aug 9 07:46:15 [FileAllocator] allocating new datafile /data/db/test-rs0-1/admin.0, filling with zeroes...
m31101| Thu Aug 9 07:46:15 [FileAllocator] done allocating datafile /data/db/test-rs0-1/admin.0, size: 16MB, took 0 secs
m31101| Thu Aug 9 07:46:15 [rsSync] datafileheader::init initializing /data/db/test-rs0-1/admin.0 n:0
m31101| Thu Aug 9 07:46:15 [rsSync] build index admin.foo { _id: 1 }
m31101| Thu Aug 9 07:46:15 [rsSync] fastBuildIndex dupsToDrop:0
m31101| Thu Aug 9 07:46:15 [rsSync] build index done. scanned 1 total records. 0 secs
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync data copy, starting syncup
m31100| Thu Aug 9 07:46:15 [conn8] end connection 127.0.0.1:45153 (7 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync building indexes
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync cloning indexes for : admin
m31100| Thu Aug 9 07:46:15 [initandlisten] connection accepted from 127.0.0.1:45154 #9 (8 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync drop all databases
m31100| Thu Aug 9 07:46:15 [conn9] end connection 127.0.0.1:45154 (7 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync query minValid
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync finishing up
m31101| Thu Aug 9 07:46:15 [rsSync] build index local.replset.minvalid { _id: 1 }
m31101| Thu Aug 9 07:46:15 [rsSync] build index done. scanned 0 total records. 0 secs
m31101| Thu Aug 9 07:46:15 [rsSync] replSet initial sync done
m31100| Thu Aug 9 07:46:15 [conn7] end connection 127.0.0.1:45152 (6 connections now open)
m31101| Thu Aug 9 07:46:15 [rsSync] replSet set minValid=5023a300:1
m31103| Thu Aug 9 07:46:16 [conn5] end connection 127.0.0.1:51929 (5 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync pending
m31102| Thu Aug 9 07:46:16 [rsSync] replSet syncing to: SERVER04:31100
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45156 #10 (7 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] build index local.me { _id: 1 }
m31102| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync drop all databases
m31102| Thu Aug 9 07:46:16 [rsSync] dropAllDatabasesExceptLocal 1
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync clone all databases
m31103| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:51957 #9 (7 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] opening db: admin
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45157 #11 (8 connections now open)
m31102| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-2/admin.ns, filling with zeroes...
m31102| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-2/admin.ns, size: 16MB, took 0 secs
m31102| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-2/admin.0, filling with zeroes...
m31102| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-2/admin.0, size: 16MB, took 0 secs
m31102| Thu Aug 9 07:46:16 [rsSync] datafileheader::init initializing /data/db/test-rs0-2/admin.0 n:0
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning db: admin
m31102| Thu Aug 9 07:46:16 [rsSync] fastBuildIndex dupsToDrop:0
m31102| Thu Aug 9 07:46:16 [rsSync] build index admin.foo { _id: 1 }
m31102| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 1 total records. 0 secs
m31100| Thu Aug 9 07:46:16 [conn11] end connection 127.0.0.1:45157 (7 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync building indexes
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning indexes for : admin
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45158 #12 (8 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync data copy, starting syncup
m31100| Thu Aug 9 07:46:16 [conn12] end connection 127.0.0.1:45158 (7 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync finishing up
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync query minValid
m31102| Thu Aug 9 07:46:16 [rsSync] build index local.replset.minvalid { _id: 1 }
m31102| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31102| Thu Aug 9 07:46:16 [rsSync] replSet initial sync done
m31100| Thu Aug 9 07:46:16 [conn10] end connection 127.0.0.1:45156 (6 connections now open)
m31102| Thu Aug 9 07:46:16 [conn7] end connection 127.0.0.1:48014 (5 connections now open)
m31102| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:48040 #9 (7 connections now open)
m31102| Thu Aug 9 07:46:16 [rsSync] replSet set minValid=5023a300:1
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync pending
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45160 #13 (7 connections now open)
m31103| Thu Aug 9 07:46:16 [rsSync] build index local.me { _id: 1 }
m31103| Thu Aug 9 07:46:16 [rsSync] replSet syncing to: SERVER04:31100
m31103| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31103| Thu Aug 9 07:46:16 [rsSync] dropAllDatabasesExceptLocal 1
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync clone all databases
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning db: admin
m31103| Thu Aug 9 07:46:16 [rsSync] opening db: admin
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45161 #14 (8 connections now open)
m31103| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-3/admin.ns, filling with zeroes...
m31103| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-3/admin.ns, size: 16MB, took 0 secs
m31103| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-3/admin.0, filling with zeroes...
m31103| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-3/admin.0, size: 16MB, took 0 secs
m31103| Thu Aug 9 07:46:16 [rsSync] datafileheader::init initializing /data/db/test-rs0-3/admin.0 n:0
m31103| Thu Aug 9 07:46:16 [rsSync] build index admin.foo { _id: 1 }
m31103| Thu Aug 9 07:46:16 [rsSync] fastBuildIndex dupsToDrop:0
m31103| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 1 total records. 0 secs
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync drop all databases
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync data copy, starting syncup
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync building indexes
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45162 #15 (9 connections now open)
m31100| Thu Aug 9 07:46:16 [conn14] end connection 127.0.0.1:45161 (7 connections now open)
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning indexes for : admin
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync finishing up
m31100| Thu Aug 9 07:46:16 [conn15] end connection 127.0.0.1:45162 (7 connections now open)
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync query minValid
m31103| Thu Aug 9 07:46:16 [rsSync] build index local.replset.minvalid { _id: 1 }
m31103| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31103| Thu Aug 9 07:46:16 [rsSync] replSet initial sync done
m31103| Thu Aug 9 07:46:16 [rsSync] replSet set minValid=5023a300:1
m31100| Thu Aug 9 07:46:16 [conn13] end connection 127.0.0.1:45160 (6 connections now open)
m31102| Thu Aug 9 07:46:16 [conn8] end connection 127.0.0.1:48019 (5 connections now open)
m31102| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:48044 #10 (7 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync pending
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45164 #16 (7 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] build index local.me { _id: 1 }
m31104| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync drop all databases
m31104| Thu Aug 9 07:46:16 [rsSync] dropAllDatabasesExceptLocal 1
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync clone all databases
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning db: admin
m31104| Thu Aug 9 07:46:16 [rsSync] opening db: admin
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45165 #17 (8 connections now open)
m31104| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-4/admin.ns, filling with zeroes...
m31104| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-4/admin.ns, size: 16MB, took 0 secs
m31104| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-rs0-4/admin.0, filling with zeroes...
m31104| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-rs0-4/admin.0, size: 16MB, took 0 secs
m31104| Thu Aug 9 07:46:16 [rsSync] datafileheader::init initializing /data/db/test-rs0-4/admin.0 n:0
m31104| Thu Aug 9 07:46:16 [rsSync] build index admin.foo { _id: 1 }
m31104| Thu Aug 9 07:46:16 [rsSync] fastBuildIndex dupsToDrop:0
m31104| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 1 total records. 0 secs
m31104| Thu Aug 9 07:46:16 [rsSync] replSet syncing to: SERVER04:31100
m31100| Thu Aug 9 07:46:16 [conn17] end connection 127.0.0.1:45165 (7 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync building indexes
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync cloning indexes for : admin
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45166 #18 (8 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync data copy, starting syncup
m31100| Thu Aug 9 07:46:16 [conn18] end connection 127.0.0.1:45166 (7 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync finishing up
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync query minValid
m31104| Thu Aug 9 07:46:16 [rsSync] build index local.replset.minvalid { _id: 1 }
m31104| Thu Aug 9 07:46:16 [rsSync] build index done. scanned 0 total records. 0 secs
m31104| Thu Aug 9 07:46:16 [rsSync] replSet initial sync done
m31100| Thu Aug 9 07:46:16 [conn16] end connection 127.0.0.1:45164 (6 connections now open)
m31104| Thu Aug 9 07:46:16 [rsSync] replSet set minValid=5023a300:1
"ts" : Timestamp(1344512768000, 1),
"h" : NumberLong("5935131880897642513"),
"op" : "i",
"ns" : "admin.foo",
"o" : {
"_id" : ObjectId("5023a3005ac10f2e307e3ca0"),
"x" : 1
}
{
ReplSetTest await TS for connection to SERVER04:31101 is 1344512768000:1 and latest is 1344512768000:1
ReplSetTest await oplog size for connection to SERVER04:31101 is 1
{
"ts" : Timestamp(1344512768000, 1),
"h" : NumberLong("5935131880897642513"),
"op" : "i",
"ns" : "admin.foo",
"o" : {
"_id" : ObjectId("5023a3005ac10f2e307e3ca0"),
"x" : 1
}
}
}
ReplSetTest await TS for connection to SERVER04:31102 is 1344512768000:1 and latest is 1344512768000:1
ReplSetTest await oplog size for connection to SERVER04:31102 is 1
"ts" : Timestamp(1344512768000, 1),
"h" : NumberLong("5935131880897642513"),
"op" : "i",
"ns" : "admin.foo",
"o" : {
"_id" : ObjectId("5023a3005ac10f2e307e3ca0"),
"x" : 1
}
{
ReplSetTest await TS for connection to SERVER04:31103 is 1344512768000:1 and latest is 1344512768000:1
ReplSetTest await oplog size for connection to SERVER04:31103 is 1
{
"ts" : Timestamp(1344512768000, 1),
"h" : NumberLong("5935131880897642513"),
"op" : "i",
"ns" : "admin.foo",
"o" : {
"_id" : ObjectId("5023a3005ac10f2e307e3ca0"),
"x" : 1
}
}
ReplSetTest await TS for connection to SERVER04:31104 is 1344512768000:1 and latest is 1344512768000:1
ReplSetTest await oplog size for connection to SERVER04:31104 is 1
ReplSetTest await synced=true
Thu Aug 9 07:46:16 starting new replica set monitor for replica set test-rs0 with seed of SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
Thu Aug 9 07:46:16 successfully connected to seed SERVER04:31100 for replica set test-rs0
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45167 #19 (7 connections now open)
Thu Aug 9 07:46:16 changing hosts to { 0: "SERVER04:31100", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102", 4: "SERVER04:31101" } from test-rs0/
Thu Aug 9 07:46:16 trying to add new host SERVER04:31100 to replica set test-rs0
Thu Aug 9 07:46:16 successfully connected to new host SERVER04:31100 in replica set test-rs0
}
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45169 #20 (8 connections now open)
m31101| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:42749 #11 (7 connections now open)
Thu Aug 9 07:46:16 successfully connected to new host SERVER04:31101 in replica set test-rs0
Thu Aug 9 07:46:16 trying to add new host SERVER04:31101 to replica set test-rs0
m31102| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:48052 #11 (7 connections now open)
Thu Aug 9 07:46:16 successfully connected to new host SERVER04:31102 in replica set test-rs0
Thu Aug 9 07:46:16 trying to add new host SERVER04:31102 to replica set test-rs0
m31103| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:51974 #10 (7 connections now open)
Thu Aug 9 07:46:16 successfully connected to new host SERVER04:31103 in replica set test-rs0
Thu Aug 9 07:46:16 trying to add new host SERVER04:31103 to replica set test-rs0
m31104| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:38415 #7 (7 connections now open)
Thu Aug 9 07:46:16 successfully connected to new host SERVER04:31104 in replica set test-rs0
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45174 #21 (9 connections now open)
Thu Aug 9 07:46:16 Primary for replica set test-rs0 changed to SERVER04:31100
m31100| Thu Aug 9 07:46:16 [conn19] end connection 127.0.0.1:45167 (8 connections now open)
m31101| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:42754 #12 (8 connections now open)
m31102| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:48057 #12 (8 connections now open)
m31103| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:51979 #11 (8 connections now open)
m31104| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:38420 #8 (8 connections now open)
Thu Aug 9 07:46:16 trying to add new host SERVER04:31104 to replica set test-rs0
Thu Aug 9 07:46:16 [ReplicaSetMonitorWatcher] starting
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45179 #22 (9 connections now open)
Resetting db path '/data/db/test-config0'
Thu Aug 9 07:46:16 replica set monitor for replica set test-rs0 started, address is test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
Thu Aug 9 07:46:16 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongod --port 29000 --dbpath /data/db/test-config0 --configsvr
m29000| Thu Aug 9 07:46:16 [initandlisten] MongoDB starting : pid=7637 port=29000 dbpath=/data/db/test-config0 64-bit host=SERVER04
m29000| Thu Aug 9 07:46:16 [initandlisten] _DEBUG build (which is slower)
m29000| Thu Aug 9 07:46:16 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5
m29000| Thu Aug 9 07:46:16 [initandlisten] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m29000| Thu Aug 9 07:46:16 [initandlisten] git version: 78de2819dca377af2e4c26b1160832336a573126
m29000| Thu Aug 9 07:46:16 [initandlisten] journal dir=/data/db/test-config0/journal
m29000| Thu Aug 9 07:46:16 [initandlisten] options: { configsvr: true, dbpath: "/data/db/test-config0", port: 29000 }
m29000| Thu Aug 9 07:46:16 [initandlisten] opening db: local
m29000| Thu Aug 9 07:46:16 [initandlisten] recover : no journal files present, no recovery needed
m29000| Thu Aug 9 07:46:16 [initandlisten] waiting for connections on port 29000
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57969 #1 (1 connection now open)
m29000| Thu Aug 9 07:46:16 [websvr] admin web console waiting for connections on port 30000
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57970 #2 (2 connections now open)
"SERVER04:29000"
ShardingTest test :
"config" : "SERVER04:29000",
"shards" : [
connection to test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
]
{
}
Thu Aug 9 07:46:16 shell: started program /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/mongos --port 30999 --configdb SERVER04:29000 --chunkSize 50
m30999| Thu Aug 9 07:46:16 warning: running with 1 config server should be done only for testing purposes and is not recommended for production
m30999| Thu Aug 9 07:46:16 [mongosMain] MongoS version 2.2.0-rc1-pre- starting: pid=7653 port=30999 64-bit host=SERVER04 (--help for usage)
m30999| Thu Aug 9 07:46:16 [mongosMain] _DEBUG build
m30999| Thu Aug 9 07:46:16 [mongosMain] build info: Linux SERVER04 2.6.35-22-server #33-Ubuntu SMP Sun Sep 19 20:48:58 UTC 2010 x86_64 BOOST_LIB_VERSION=1_49
m30999| Thu Aug 9 07:46:16 [mongosMain] git version: 78de2819dca377af2e4c26b1160832336a573126
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57972 #3 (3 connections now open)
m29000| Thu Aug 9 07:46:16 [conn3] opening db: config
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57973 #4 (4 connections now open)
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57974 #5 (5 connections now open)
m29000| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-config0/config.ns, filling with zeroes...
m29000| Thu Aug 9 07:46:16 [FileAllocator] creating directory /data/db/test-config0/_tmp
m29000| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-config0/config.ns, size: 16MB, took 0 secs
m30999| Thu Aug 9 07:46:16 [mongosMain] options: { chunkSize: 50, configdb: "SERVER04:29000", port: 30999 }
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45188 #23 (10 connections now open)
m31101| Thu Aug 9 07:46:16 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31101| Thu Aug 9 07:46:16 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
m31100| Thu Aug 9 07:46:16 [conn23] query has no more but tailable, cursorid: 6523209536377248421
m29000| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-config0/config.0, filling with zeroes...
m31101| Thu Aug 9 07:46:16 [rsBackgroundSync] replSet syncing to: SERVER04:31100
m29000| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-config0/config.0, size: 16MB, took 0 secs
m29000| Thu Aug 9 07:46:16 [FileAllocator] allocating new datafile /data/db/test-config0/config.1, filling with zeroes...
m29000| Thu Aug 9 07:46:16 [FileAllocator] done allocating datafile /data/db/test-config0/config.1, size: 32MB, took 0 secs
m29000| Thu Aug 9 07:46:16 [conn5] build index config.version { _id: 1 }
m29000| Thu Aug 9 07:46:16 [conn5] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] build index config.settings { _id: 1 }
m29000| Thu Aug 9 07:46:16 [conn5] datafileheader::init initializing /data/db/test-config0/config.0 n:0
m30999| Thu Aug 9 07:46:16 [Balancer] about to contact config servers and shards
m30999| Thu Aug 9 07:46:16 [mongosMain] waiting for connections on port 30999
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m30999| Thu Aug 9 07:46:16 [Balancer] config servers and shards contacted successfully
m30999| Thu Aug 9 07:46:16 [Balancer] balancer id: SERVER04:30999 started at Aug 9 07:46:16
m30999| Thu Aug 9 07:46:16 [Balancer] created new distributed lock for balancer on SERVER04:29000 ( lock timeout : 900000, ping interval : 30000, process : 0 )
m29000| Thu Aug 9 07:46:16 [conn4] build index config.chunks { _id: 1 }
m29000| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:57976 #6 (6 connections now open)
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] info: creating collection config.chunks on add index
m29000| Thu Aug 9 07:46:16 [conn4] build index config.chunks { ns: 1, min: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m30999| Thu Aug 9 07:46:16 [websvr] admin web console waiting for connections on port 31999
m29000| Thu Aug 9 07:46:16 [conn5] build index config.mongos { _id: 1 }
m29000| Thu Aug 9 07:46:16 [conn5] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] build index config.chunks { ns: 1, shard: 1, min: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index config.chunks { ns: 1, lastmod: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] build index config.shards { _id: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] build index config.shards { host: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn4] info: creating collection config.shards on add index
m29000| Thu Aug 9 07:46:16 [conn4] build index config.lockpings { _id: 1 }
m30999| Thu Aug 9 07:46:16 [LockPinger] creating distributed lock ping thread for SERVER04:29000 and process SERVER04:30999:1344512776:1804289383 (sleeping for 30000ms)
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 0 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn6] build index config.locks { _id: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index config.lockpings { ping: 1 }
m29000| Thu Aug 9 07:46:16 [conn4] build index done. scanned 1 total records. 0 secs
m29000| Thu Aug 9 07:46:16 [conn6] build index done. scanned 0 total records. 0 secs
m30999| Thu Aug 9 07:46:16 [Balancer] distributed lock 'balancer/SERVER04:30999:1344512776:1804289383' acquired, ts : 5023a30896b48f4e35e89db5
m30999| Thu Aug 9 07:46:16 [Balancer] distributed lock 'balancer/SERVER04:30999:1344512776:1804289383' unlocked. 
m31100| Thu Aug 9 07:46:16 [initandlisten] connection accepted from 127.0.0.1:45190 #24 (11 connections now open)
m31100| Thu Aug 9 07:46:16 [conn24] query has no more but tailable, cursorid: 7808993273010510539
m31101| Thu Aug 9 07:46:16 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m30999| Thu Aug 9 07:46:17 [mongosMain] connection accepted from 127.0.0.1:38000 #1 (1 connection now open)
m31101| Thu Aug 9 07:46:16 [rsSync] replSet SECONDARY
m30999| Thu Aug 9 07:46:17 [conn1] couldn't find database [admin] in config db
m29000| Thu Aug 9 07:46:17 [conn4] build index config.databases { _id: 1 }
m29000| Thu Aug 9 07:46:17 [conn4] build index done. scanned 0 total records. 0 secs
m30999| Thu Aug 9 07:46:17 [conn1] put [admin] on: config:SERVER04:29000
m30999| Thu Aug 9 07:46:17 [conn1] starting new replica set monitor for replica set test-rs0 with seed of SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to seed SERVER04:31100 for replica set test-rs0
m30999| Thu Aug 9 07:46:17 [conn1] changing hosts to { 0: "SERVER04:31100", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102", 4: "SERVER04:31101" } from test-rs0/
m30999| Thu Aug 9 07:46:17 [conn1] trying to add new host SERVER04:31100 to replica set test-rs0
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to new host SERVER04:31100 in replica set test-rs0
m30999| Thu Aug 9 07:46:17 [conn1] trying to add new host SERVER04:31101 to replica set test-rs0
m31101| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:42773 #13 (9 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to new host SERVER04:31101 in replica set test-rs0
ShardingTest undefined going to add shard : test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:46:17 [conn1] trying to add new host SERVER04:31102 to replica set test-rs0
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to new host SERVER04:31102 in replica set test-rs0
m30999| Thu Aug 9 07:46:17 [conn1] trying to add new host SERVER04:31103 to replica set test-rs0
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45192 #25 (12 connections now open)
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45193 #26 (13 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to new host SERVER04:31103 in replica set test-rs0
m31102| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:48076 #13 (9 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] trying to add new host SERVER04:31104 to replica set test-rs0
m31103| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:51998 #12 (9 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] successfully connected to new host SERVER04:31104 in replica set test-rs0
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45198 #27 (14 connections now open)
m31100| Thu Aug 9 07:46:17 [conn25] end connection 127.0.0.1:45192 (13 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] Primary for replica set test-rs0 changed to SERVER04:31100
m31101| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:42778 #14 (10 connections now open)
m31102| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:48082 #14 (10 connections now open)
m31103| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:52004 #13 (10 connections now open)
m31104| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:38439 #9 (9 connections now open)
m31104| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:38445 #10 (10 connections now open)
m30999| Thu Aug 9 07:46:17 [ReplicaSetMonitorWatcher] starting
m30999| Thu Aug 9 07:46:17 [conn1] replica set monitor for replica set test-rs0 started, address is test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:46:17 [conn1] going to add shard: { _id: "test-rs0", host: "test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104" }
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45204 #28 (14 connections now open)
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45205 #29 (15 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:31100 serverID: 5023a30896b48f4e35e89db4
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:31101 serverID: 5023a30896b48f4e35e89db4
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:31102 serverID: 5023a30896b48f4e35e89db4
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:31103 serverID: 5023a30896b48f4e35e89db4
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:31104 serverID: 5023a30896b48f4e35e89db4
m29000| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:57993 #7 (7 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] creating WriteBackListener for: SERVER04:29000 serverID: 5023a30896b48f4e35e89db4
Waiting for active hosts...
Waiting for the balancer lock...
m31102| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet syncing to: SERVER04:31100
Waiting again for active hosts after balancer is off...
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45207 #30 (16 connections now open)
m30999| Thu Aug 9 07:46:17 [conn1] couldn't find database [test] in config db
m31102| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31102| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
{ "shardAdded" : "test-rs0", "ok" : 1 }
m30999| Thu Aug 9 07:46:17 [conn1] put [test] on: test-rs0:test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m31100| Thu Aug 9 07:46:17 [conn29] _DEBUG ReadContext db wasn't open, will try to open test.user
m31100| Thu Aug 9 07:46:17 [conn29] opening db: test
m31100| Thu Aug 9 07:46:17 [conn30] query has no more but tailable, cursorid: 1680317109054528370
----
----
----
Changing conf to {
"_id" : "test-rs0",
"version" : 2,
"members" : [
{
"_id" : 0,
"host" : "SERVER04:31100",
"priority" : 1
},
{
"_id" : 1,
"host" : "SERVER04:31101",
"priority" : 1
},
{
"_id" : 2,
"host" : "SERVER04:31102",
"priority" : 1
},
{
"_id" : 3,
"host" : "SERVER04:31103",
"priority" : 1
},
{
"_id" : 4,
"host" : "SERVER04:31104",
"priority" : 100
}
]
Iteration to remove node 4/4
----
m31100| Thu Aug 9 07:46:17 [conn2] replSet replSetReconfig config object parses ok, 5 members specified
m31100| Thu Aug 9 07:46:17 [conn2] replSet replSetReconfig [2]
m31100| Thu Aug 9 07:46:17 [conn2] replSet info saving a newer config version to local.system.replset
m31100| Thu Aug 9 07:46:17 [conn2] replSet saveConfigLocally done
}
m31100| Thu Aug 9 07:46:17 [conn2] replSet debug: cleared old tasks 4
m31100| Thu Aug 9 07:46:17 [conn2] replSet SECONDARY
m31100| Thu Aug 9 07:46:17 [conn2] replSet closing client sockets after relinquishing primary
m31100| Thu Aug 9 07:46:17 [conn2] replSet relinquishing primary state
m30999| Thu Aug 9 07:46:17 [WriteBackListener-SERVER04:31100] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:17 [WriteBackListener-SERVER04:31100] dev: lastError==0 won't report:DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m30999| Thu Aug 9 07:46:17 [WriteBackListener-SERVER04:31100] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31101| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
m31102| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
m31101| Thu Aug 9 07:46:17 [conn10] end connection 127.0.0.1:42729 (9 connections now open)
m31104| Thu Aug 9 07:46:17 [conn3] end connection 127.0.0.1:38357 (9 connections now open)
Thu Aug 9 07:46:17 DBClientCursor::init call() failed
m31103| Thu Aug 9 07:46:17 [conn7] end connection 127.0.0.1:51949 (9 connections now open)
Expected exception because of reconfigError: error doing query: failed
m31102| Thu Aug 9 07:46:17 [conn4] end connection 127.0.0.1:47997 (9 connections now open)
m31100| Thu Aug 9 07:46:17 [conn2] replSet PRIMARY
Thu Aug 9 07:46:17 query failed : admin.$cmd { replSetReconfig: { _id: "test-rs0", version: 2.0, members: [ { _id: 0.0, host: "SERVER04:31100", priority: 1.0 }, { _id: 1.0, host: "SERVER04:31101", priority: 1.0 }, { _id: 2.0, host: "SERVER04:31102", priority: 1.0 }, { _id: 3.0, host: "SERVER04:31103", priority: 1.0 }, { _id: 4.0, host: "SERVER04:31104", priority: 100.0 } ] } } to: 127.0.0.1:31100
m31100| Thu Aug 9 07:46:17 [conn2] starting rsHealthPoll for SERVER04:31103
m31100| Thu Aug 9 07:46:17 [conn2] starting rsHealthPoll for SERVER04:31102
m31100| Thu Aug 9 07:46:17 [conn2] starting rsHealthPoll for SERVER04:31101
m31100| Thu Aug 9 07:46:17 [conn1] end connection 127.0.0.1:45096 (15 connections now open)
m31100| Thu Aug 9 07:46:17 [conn2] replSet replSetReconfig new config saved locally
m31100| Thu Aug 9 07:46:17 [conn2] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45097] 
m31100| Thu Aug 9 07:46:17 [conn2] starting rsHealthPoll for SERVER04:31104
m31100| Thu Aug 9 07:46:17 [conn2] thread conn2 stack usage was 19768 bytes, which is the most so far
m31100| Thu Aug 9 07:46:17 [conn23] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45188] 
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31101
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet info SERVER04:31104 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31104
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31103
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31100| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31104 is now in state DOWN
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:17 [conn30] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45207] 
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45209 #31 (13 connections now open)
m31100| Thu Aug 9 07:46:17 [conn31] query has no more but tailable, cursorid: 2257974082764331933
m31102| Thu Aug 9 07:46:17 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m31102| Thu Aug 9 07:46:17 [rsSync] replSet SECONDARY
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45210 #32 (14 connections now open)
m31103| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31103| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
m31100| Thu Aug 9 07:46:17 [conn32] query has no more but tailable, cursorid: 4878059069974567998
m31103| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet syncing to: SERVER04:31100
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
Current replView: {
"master" : 0,
"nextSlave" : 0
}
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45212 #33 (15 connections now open)
m31100| Thu Aug 9 07:46:17 [conn33] query has no more but tailable, cursorid: 704783934230420571
m31103| Thu Aug 9 07:46:17 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m31103| Thu Aug 9 07:46:17 [rsSync] replSet SECONDARY
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45214 #34 (16 connections now open)
m31104| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31104| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet syncing to: SERVER04:31100
m31100| Thu Aug 9 07:46:17 [conn34] query has no more but tailable, cursorid: 7691534331305843978
m31104| Thu Aug 9 07:46:17 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
m31104| Thu Aug 9 07:46:17 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m31100| Thu Aug 9 07:46:17 [conn35] query has no more but tailable, cursorid: 4997735022257823022
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45215 #35 (17 connections now open)
m31100| Thu Aug 9 07:46:17 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:17 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:17 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:17 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:17 [rsSync] replSet SECONDARY
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
Current replView: {
}
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:17 [conn3] end connection 127.0.0.1:45117 (16 connections now open)
m31100| Thu Aug 9 07:46:17 [initandlisten] connection accepted from 127.0.0.1:45216 #36 (18 connections now open)
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsMgr] replSet info saving a newer config version to local.system.replset
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsMgr] replSet saveConfigLocally done
m31101| Thu Aug 9 07:46:17 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31101| Thu Aug 9 07:46:17 [rsMgr] replSet debug: cleared old tasks 4
m31101| Thu Aug 9 07:46:17 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31101| Thu Aug 9 07:46:17 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31101| Thu Aug 9 07:46:17 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31101| Thu Aug 9 07:46:17 [rsMgr] replSet replSetReconfig new config saved locally
m31101| Thu Aug 9 07:46:17 [rsMgr] replSet can't see a majority, will not try to elect self
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31103 is up
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31104 is up
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31100 is up
m31101| Thu Aug 9 07:46:17 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31101| Thu Aug 9 07:46:17 [rsMgr] starting rsHealthPoll for SERVER04:31104
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:17 [slaveTracking] build index done. scanned 0 total records. 0 secs
m31100| Thu Aug 9 07:46:17 [slaveTracking] build index local.slaves { _id: 1 }
m31100| Thu Aug 9 07:46:18 [conn4] end connection 127.0.0.1:45118 (16 connections now open)
m31100| Thu Aug 9 07:46:18 [initandlisten] connection accepted from 127.0.0.1:45219 #37 (18 connections now open)
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsMgr] replSet info saving a newer config version to local.system.replset
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsMgr] replSet saveConfigLocally done
m31102| Thu Aug 9 07:46:18 [rsMgr] replSet debug: cleared old tasks 4
m31102| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31102| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31102| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31102| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31102| Thu Aug 9 07:46:18 [rsMgr] replSet replSetReconfig new config saved locally
m31102| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31102| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is up
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is up
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is up
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31100| Thu Aug 9 07:46:18 [initandlisten] connection accepted from 127.0.0.1:45220 #38 (18 connections now open)
m31102| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is up
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:18 [conn5] end connection 127.0.0.1:45121 (17 connections now open)
m31100| Thu Aug 9 07:46:18 [initandlisten] connection accepted from 127.0.0.1:45221 #39 (19 connections now open)
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet saveConfigLocally done
m31103| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet debug: cleared old tasks 4
m31103| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31103| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31103| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet replSetReconfig new config saved locally
m31103| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is up
m31103| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is up
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is up
m31103| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31103| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31104
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:18 [conn6] end connection 127.0.0.1:45122 (17 connections now open)
m31100| Thu Aug 9 07:46:18 [initandlisten] connection accepted from 127.0.0.1:45222 #40 (19 connections now open)
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet saveConfigLocally done
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet debug: cleared old tasks 4
m31104| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31104| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31104| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet replSetReconfig new config saved locally
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet can't see a majority, will not try to elect self
m31104| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31104| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31104| Thu Aug 9 07:46:18 [rsMgr] replset msgReceivedNewConfig version: version: 2
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is up
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31100 is now in state PRIMARY
m31104| Thu Aug 9 07:46:18 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31102 is up
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31104| Thu Aug 9 07:46:18 [rsHealthPoll] replSet member SERVER04:31103 is up
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:19 [initandlisten] connection accepted from 127.0.0.1:42805 #15 (10 connections now open)
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31104 is up
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31103| Thu Aug 9 07:46:19 [initandlisten] connection accepted from 127.0.0.1:52029 #14 (10 connections now open)
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31101 is up
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:46:19 [initandlisten] connection accepted from 127.0.0.1:48109 #15 (10 connections now open)
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31103 is up
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31102 is up
m31100| Thu Aug 9 07:46:19 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31104| Thu Aug 9 07:46:19 [initandlisten] connection accepted from 127.0.0.1:38467 #11 (10 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31102",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
Current replView: {
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:19 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:19 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:19 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:19 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:19 [conn4] end connection 127.0.0.1:38365 (9 connections now open)
m31104| Thu Aug 9 07:46:19 [initandlisten] connection accepted from 127.0.0.1:38473 #12 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:20 [conn5] end connection 127.0.0.1:38372 (9 connections now open)
m31104| Thu Aug 9 07:46:20 [initandlisten] connection accepted from 127.0.0.1:38474 #13 (11 connections now open)
"hosts" : [
Current replView: {
"addr" : "SERVER04:31100",
{
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : false,
{
},
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:20 [conn6] end connection 127.0.0.1:38376 (9 connections now open)
m31104| Thu Aug 9 07:46:20 [initandlisten] connection accepted from 127.0.0.1:38477 #14 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:20 [conn6] end connection 127.0.0.1:51939 (9 connections now open)
m31103| Thu Aug 9 07:46:20 [initandlisten] connection accepted from 127.0.0.1:52038 #15 (11 connections now open)
m31104| Thu Aug 9 07:46:20 ERROR: Client::shutdown not called: rsHealthPoll
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:21 [conn15] end connection 127.0.0.1:48109 (9 connections now open)
m31102| Thu Aug 9 07:46:21 [initandlisten] connection accepted from 127.0.0.1:48120 #16 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:21 [conn6] end connection 127.0.0.1:48006 (9 connections now open)
m31102| Thu Aug 9 07:46:21 [initandlisten] connection accepted from 127.0.0.1:48123 #17 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:22 [conn5] end connection 127.0.0.1:42708 (9 connections now open)
m31101| Thu Aug 9 07:46:22 [initandlisten] connection accepted from 127.0.0.1:42822 #16 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
Current replView: {
"nextSlave" : 0
}
m31101| Thu Aug 9 07:46:22 [conn7] end connection 127.0.0.1:42715 (9 connections now open)
m31101| Thu Aug 9 07:46:22 [initandlisten] connection accepted from 127.0.0.1:42823 #17 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:22 [conn9] end connection 127.0.0.1:42719 (9 connections now open)
m31101| Thu Aug 9 07:46:22 [initandlisten] connection accepted from 127.0.0.1:42824 #18 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
Current replView: {
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
"hosts" : [
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
{
}
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:23 [conn36] replSet info stepping down as primary secs=1
m31100| Thu Aug 9 07:46:23 [conn36] replSet relinquishing primary state
m31100| Thu Aug 9 07:46:23 [conn36] replSet SECONDARY
m31100| Thu Aug 9 07:46:23 [conn36] replSet closing client sockets after relinquishing primary
m31101| Thu Aug 9 07:46:23 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31101| Thu Aug 9 07:46:23 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31101| Thu Aug 9 07:46:23 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31103| Thu Aug 9 07:46:23 [conn14] end connection 127.0.0.1:52029 (9 connections now open)
m31103| Thu Aug 9 07:46:23 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
m31101| Thu Aug 9 07:46:23 [rsMgr] stepping down SERVER04:31100 failed: { errmsg: "not primary so can't step down", ok: 0.0 }
m30999| Thu Aug 9 07:46:23 [WriteBackListener-SERVER04:31100] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:23 [WriteBackListener-SERVER04:31100] dev: lastError==0 won't report:DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m30999| Thu Aug 9 07:46:23 [WriteBackListener-SERVER04:31100] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31102| Thu Aug 9 07:46:23 [conn16] end connection 127.0.0.1:48120 (9 connections now open)
m31104| Thu Aug 9 07:46:23 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
m31101| Thu Aug 9 07:46:23 [conn15] end connection 127.0.0.1:42805 (9 connections now open)
m31101| Thu Aug 9 07:46:23 [rsMgr] not electing self, we are not freshest
m31104| Thu Aug 9 07:46:23 [conn11] end connection 127.0.0.1:38467 (9 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
m31102| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31102| Thu Aug 9 07:46:24 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31102| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31102| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 failed: { errmsg: "not primary so can't step down", ok: 0.0 }
m31102| Thu Aug 9 07:46:24 [rsMgr] not electing self, we are not freshest
m31102| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 failed: { errmsg: "not primary so can't step down", ok: 0.0 }
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31103| Thu Aug 9 07:46:24 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31103| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 failed: { errmsg: "not primary so can't step down", ok: 0.0 }
m31103| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 (priority 1), SERVER04:31104 is priority 100 and 0 seconds behind
m31103| Thu Aug 9 07:46:24 [rsMgr] not electing self, SERVER04:31104 would veto
m31103| Thu Aug 9 07:46:24 [rsMgr] stepping down SERVER04:31100 failed: { errmsg: "not primary so can't step down", ok: 0.0 }
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
m31104| Thu Aug 9 07:46:24 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31104| Thu Aug 9 07:46:24 [rsMgr] replSet tie 2 sleeping a little 749ms
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:25 [rsHealthPoll] replSet info SERVER04:31104 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31104
m31100| Thu Aug 9 07:46:25 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31101
m31100| Thu Aug 9 07:46:25 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
m31100| Thu Aug 9 07:46:25 [MultiCommandJob] dev caught dbexception on multiCommand SERVER04:31102
m31100| Thu Aug 9 07:46:25 [MultiCommandJob] dev caught dbexception on multiCommand SERVER04:31103
m31100| Thu Aug 9 07:46:25 [rsHealthPoll] replSet member SERVER04:31104 is now in state DOWN
m31101| Thu Aug 9 07:46:25 [initandlisten] connection accepted from 127.0.0.1:42834 #19 (10 connections now open)
m31102| Thu Aug 9 07:46:25 [initandlisten] connection accepted from 127.0.0.1:48137 #18 (10 connections now open)
m31100| Thu Aug 9 07:46:25 [rsMgr] replSet freshest returns {}
m31100| Thu Aug 9 07:46:25 [rsMgr] replSet freshest returns {}
m31100| Thu Aug 9 07:46:25 [rsMgr] not electing self, SERVER04:31101 would veto
m31100| Thu Aug 9 07:46:25 [rsMgr] not electing self, SERVER04:31103 would veto
m31103| Thu Aug 9 07:46:25 [initandlisten] connection accepted from 127.0.0.1:52056 #16 (10 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:25 [conn32] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45210] 
m31104| Thu Aug 9 07:46:25 [rsMgr] not electing self, SERVER04:31100 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:25 [conn34] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45214] 
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : true,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:25 [initandlisten] connection accepted from 127.0.0.1:45258 #41 (17 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31104",
"ismaster" : false,
"hidden" : false,
"ok" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31100
m31100| Thu Aug 9 07:46:26 [conn20] end connection 127.0.0.1:45169 (16 connections now open)
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] reconnect SERVER04:31100 ok
m31100| Thu Aug 9 07:46:26 [initandlisten] connection accepted from 127.0.0.1:45260 #42 (18 connections now open)
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:46:26 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
m31100| Thu Aug 9 07:46:26 [conn21] end connection 127.0.0.1:45174 (16 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
Current replView: {
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : false,
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
},
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : false,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] dev: lastError==0 won't report:DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { ismaster: 1 }
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31100
m31100| Thu Aug 9 07:46:27 [conn26] end connection 127.0.0.1:45193 (15 connections now open)
m30999| Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] reconnect SERVER04:31100 ok
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45263 #43 (16 connections now open)
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45264 #44 (17 connections now open)
m31101| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:42844 #20 (11 connections now open)
m31102| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:48147 #19 (11 connections now open)
m31103| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:52069 #17 (11 connections now open)
m31101| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet syncing to: SERVER04:31100
m31102| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet syncing to: SERVER04:31100
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45269 #45 (18 connections now open)
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45270 #46 (19 connections now open)
m31101| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31101| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
m31100| Thu Aug 9 07:46:27 [conn45] query has no more but tailable, cursorid: 8526439303217480338
m31102| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:45:50 5023a2ee:1
m31102| Thu Aug 9 07:46:27 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:08 5023a300:1
m31101| Thu Aug 9 07:46:27 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m31100| Thu Aug 9 07:46:27 [conn24] end connection 127.0.0.1:45190 (18 connections now open)
m31100| Thu Aug 9 07:46:27 [conn46] query has no more but tailable, cursorid: 3371370420685308563
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45271 #47 (20 connections now open)
m31102| Thu Aug 9 07:46:27 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31100
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45272 #48 (20 connections now open)
m31100| Thu Aug 9 07:46:27 [conn31] end connection 127.0.0.1:45209 (18 connections now open)
m31104| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:38510 #15 (10 connections now open)
m31100| Thu Aug 9 07:46:27 [conn47] query has no more but tailable, cursorid: 1051656363617616533
m31100| Thu Aug 9 07:46:27 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31100| Thu Aug 9 07:46:27 [rsHealthPoll] replSet member SERVER04:31101 is up
m31100| Thu Aug 9 07:46:27 [rsMgr] not electing self, SERVER04:31103 would veto
m31100| Thu Aug 9 07:46:27 [conn48] query has no more but tailable, cursorid: 2902704005957616279
m31100| Thu Aug 9 07:46:27 [rsHealthPoll] replSet member SERVER04:31104 is up
m31100| Thu Aug 9 07:46:27 [rsHealthPoll] replSet member SERVER04:31104 is now in state SECONDARY
m31100| Thu Aug 9 07:46:27 [rsMgr] not electing self, SERVER04:31104 would veto
m31104| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:38515 #16 (11 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
},
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31100 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31100", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101" ], me: "SERVER04:31100", maxBsonObjectSize: 16777216, localTime: new Date(1344512787650), ok: 1.0 }
m31100| Thu Aug 9 07:46:27 [initandlisten] connection accepted from 127.0.0.1:45276 #49 (20 connections now open)
Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31101 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31101", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31100" ], me: "SERVER04:31101", maxBsonObjectSize: 16777216, localTime: new Date(1344512787651), ok: 1.0 }
Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31102 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31102", "SERVER04:31104", "SERVER04:31103", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31102", maxBsonObjectSize: 16777216, localTime: new Date(1344512787652), ok: 1.0 }
Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31103 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31103", "SERVER04:31104", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31103", maxBsonObjectSize: 16777216, localTime: new Date(1344512787652), ok: 1.0 }
Thu Aug 9 07:46:27 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31104 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31104", maxBsonObjectSize: 16777216, localTime: new Date(1344512787653), ok: 1.0 }
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
}
"master" : 0,
"nextSlave" : 0
],
}
Current replView: {
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
"hosts" : [
"master" : 0,
"nextSlave" : 0
],
}
m30999| Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31100 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31100", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101" ], me: "SERVER04:31100", maxBsonObjectSize: 16777216, localTime: new Date(1344512788073), ok: 1.0 }
m30999| Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31101 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31101", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31100" ], me: "SERVER04:31101", maxBsonObjectSize: 16777216, localTime: new Date(1344512788073), ok: 1.0 }
m30999| Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31102 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31102", "SERVER04:31104", "SERVER04:31103", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31102", maxBsonObjectSize: 16777216, localTime: new Date(1344512788074), ok: 1.0 }
m30999| Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31103 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31103", "SERVER04:31104", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31103", maxBsonObjectSize: 16777216, localTime: new Date(1344512788074), ok: 1.0 }
m30999| Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31104 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31104", maxBsonObjectSize: 16777216, localTime: new Date(1344512788075), ok: 1.0 }
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : 0,
"nextSlave" : 0
Current replView: {
}
Thu Aug 9 07:46:28 [ReplicaSetMonitorWatcher] warning: No primary detected for set test-rs0
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31104",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : 0,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : 0,
"nextSlave" : 0
],
}
m30999| Thu Aug 9 07:46:29 [ReplicaSetMonitorWatcher] warning: No primary detected for set test-rs0
Current replView: {
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
"hosts" : [
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:29 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
},
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:30 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:30 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:30 [rsMgr] replSet not trying to elect self as responded yea to someone else recently
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
Current replView: {
"master" : -1,
"nextSlave" : 0
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31103",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
Current replView: {
"master" : -1,
"nextSlave" : 0
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:33 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
Current replView: {
"addr" : "SERVER04:31100",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31102",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m31103| Thu Aug 9 07:46:35 [conn16] end connection 127.0.0.1:52056 (10 connections now open)
m31103| Thu Aug 9 07:46:35 [initandlisten] connection accepted from 127.0.0.1:52095 #18 (12 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:35 [conn8] end connection 127.0.0.1:51953 (10 connections now open)
m31101| Thu Aug 9 07:46:35 [rsMgr] not electing self, SERVER04:31104 would veto
m31103| Thu Aug 9 07:46:35 [initandlisten] connection accepted from 127.0.0.1:52098 #19 (12 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m31103| Thu Aug 9 07:46:36 [conn9] end connection 127.0.0.1:51957 (10 connections now open)
m31102| Thu Aug 9 07:46:36 [rsMgr] not electing self, SERVER04:31104 would veto
m31103| Thu Aug 9 07:46:36 [initandlisten] connection accepted from 127.0.0.1:52099 #20 (12 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
},
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:36 [conn9] end connection 127.0.0.1:48040 (10 connections now open)
m31102| Thu Aug 9 07:46:36 [initandlisten] connection accepted from 127.0.0.1:48181 #20 (12 connections now open)
m31103| Thu Aug 9 07:46:36 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:36 [conn10] end connection 127.0.0.1:48044 (10 connections now open)
m31102| Thu Aug 9 07:46:36 [initandlisten] connection accepted from 127.0.0.1:48182 #21 (11 connections now open)
m31104| Thu Aug 9 07:46:36 [rsMgr] replSet tie 4 sleeping a little 190ms
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
Current replView: {
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:36 [rsMgr] replSet not trying to elect self as responded yea to someone else recently
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:37 [conn19] end connection 127.0.0.1:42834 (10 connections now open)
m31101| Thu Aug 9 07:46:37 [initandlisten] connection accepted from 127.0.0.1:42883 #21 (12 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:37 [conn36] end connection 127.0.0.1:45216 (19 connections now open)
m31100| Thu Aug 9 07:46:37 [initandlisten] connection accepted from 127.0.0.1:45305 #50 (21 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:38 [conn37] end connection 127.0.0.1:45219 (19 connections now open)
m31100| Thu Aug 9 07:46:38 [initandlisten] connection accepted from 127.0.0.1:45308 #51 (21 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:38 [conn39] end connection 127.0.0.1:45221 (19 connections now open)
m31100| Thu Aug 9 07:46:38 [initandlisten] connection accepted from 127.0.0.1:45309 #52 (21 connections now open)
Current replView: {
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
"hosts" : [
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:38 [conn40] end connection 127.0.0.1:45222 (19 connections now open)
m31100| Thu Aug 9 07:46:38 [initandlisten] connection accepted from 127.0.0.1:45310 #53 (21 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:39 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31103",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
},
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
],
"master" : -1,
"nextSlave" : 0
Thu Aug 9 07:46:39 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31100 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31100", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101" ], me: "SERVER04:31100", maxBsonObjectSize: 16777216, localTime: new Date(1344512799656), ok: 1.0 }
Thu Aug 9 07:46:39 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31101 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31101", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31100" ], me: "SERVER04:31101", maxBsonObjectSize: 16777216, localTime: new Date(1344512799657), ok: 1.0 }
Thu Aug 9 07:46:39 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31102 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31102", "SERVER04:31104", "SERVER04:31103", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31102", maxBsonObjectSize: 16777216, localTime: new Date(1344512799657), ok: 1.0 }
Thu Aug 9 07:46:39 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31103 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31103", "SERVER04:31104", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31103", maxBsonObjectSize: 16777216, localTime: new Date(1344512799658), ok: 1.0 }
Thu Aug 9 07:46:39 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31104 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31104", maxBsonObjectSize: 16777216, localTime: new Date(1344512799658), ok: 1.0 }
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m30999| Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31100 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31100", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101" ], me: "SERVER04:31100", maxBsonObjectSize: 16777216, localTime: new Date(1344512800078), ok: 1.0 }
m30999| Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31101 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31101", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31100" ], me: "SERVER04:31101", maxBsonObjectSize: 16777216, localTime: new Date(1344512800078), ok: 1.0 }
m30999| Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31102 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31102", "SERVER04:31104", "SERVER04:31103", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31102", maxBsonObjectSize: 16777216, localTime: new Date(1344512800079), ok: 1.0 }
m30999| Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31103 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31103", "SERVER04:31104", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31103", maxBsonObjectSize: 16777216, localTime: new Date(1344512800079), ok: 1.0 }
m30999| Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] ReplicaSetMonitor::_checkConnection: SERVER04:31104 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], me: "SERVER04:31104", maxBsonObjectSize: 16777216, localTime: new Date(1344512800080), ok: 1.0 }
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
Thu Aug 9 07:46:40 [ReplicaSetMonitorWatcher] warning: No primary detected for set test-rs0
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m30999| Thu Aug 9 07:46:41 [ReplicaSetMonitorWatcher] warning: No primary detected for set test-rs0
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
],
"nextSlave" : 0
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:41 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:42 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:42 [rsMgr] not electing self, SERVER04:31104 would veto
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet tie 4 sleeping a little 114ms
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:42 [conn15] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31104", whoid: 4, cfgver: 2, round: ObjectId('5023a32248978dc431b8d10d') }
m31103| Thu Aug 9 07:46:42 [conn15] replSet info voting yea for SERVER04:31104 (4)
m31101| Thu Aug 9 07:46:42 [conn18] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31104", whoid: 4, cfgver: 2, round: ObjectId('5023a32248978dc431b8d10d') }
m31101| Thu Aug 9 07:46:42 [conn18] replSet info voting yea for SERVER04:31104 (4)
m31102| Thu Aug 9 07:46:42 [conn21] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31104", whoid: 4, cfgver: 2, round: ObjectId('5023a32248978dc431b8d10d') }
m31102| Thu Aug 9 07:46:42 [conn21] replSet info voting yea for SERVER04:31104 (4)
m31100| Thu Aug 9 07:46:42 [conn53] replSet received elect msg { replSetElect: 1, set: "test-rs0", who: "SERVER04:31104", whoid: 4, cfgver: 2, round: ObjectId('5023a32248978dc431b8d10d') }
m31100| Thu Aug 9 07:46:42 [conn53] replSet info voting yea for SERVER04:31104 (4)
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a32248978dc431b8d10d'), ok: 1.0 }
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a32248978dc431b8d10d'), ok: 1.0 }
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a32248978dc431b8d10d'), ok: 1.0 }
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet elect res: { vote: 1, round: ObjectId('5023a32248978dc431b8d10d'), ok: 1.0 }
m31104| Thu Aug 9 07:46:42 [rsMgr] info PageFaultRetryableSection will not yield, already locked upon reaching
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet PRIMARY
m31104| Thu Aug 9 07:46:42 [rsMgr] replSet info electSelf 4
"hosts" : [
Current replView: {
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
},
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
m31100| Thu Aug 9 07:46:43 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31102",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m31100| Thu Aug 9 07:46:43 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31100| Thu Aug 9 07:46:43 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31100| Thu Aug 9 07:46:43 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31104| Thu Aug 9 07:46:43 [conn17] query has no more but tailable, cursorid: 5005686226493457214
m31104| Thu Aug 9 07:46:43 [initandlisten] connection accepted from 127.0.0.1:38565 #17 (12 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31101| Thu Aug 9 07:46:43 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31102| Thu Aug 9 07:46:44 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m31103| Thu Aug 9 07:46:44 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
},
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
{
"pingTimeMillis" : 0
}
"master" : -1,
"nextSlave" : 0
],
m31100| Thu Aug 9 07:46:44 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:46:44 [initandlisten] connection accepted from 127.0.0.1:38569 #18 (13 connections now open)
m31100| Thu Aug 9 07:46:44 [rsSyncNotifier] build index local.me { _id: 1 }
m31100| Thu Aug 9 07:46:44 [rsSyncNotifier] build index done. scanned 0 total records. 0 secs
m31104| Thu Aug 9 07:46:44 [conn18] query has no more but tailable, cursorid: 6157533254836897576
Current replView: {
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
}
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:44 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31103| Thu Aug 9 07:46:44 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31103| Thu Aug 9 07:46:44 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31104| Thu Aug 9 07:46:44 [conn19] query has no more but tailable, cursorid: 2226448503120676875
m31104| Thu Aug 9 07:46:44 [initandlisten] connection accepted from 127.0.0.1:38571 #19 (14 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:45 [slaveTracking] build index local.slaves { _id: 1 }
m31104| Thu Aug 9 07:46:45 [slaveTracking] build index done. scanned 0 total records. 0 secs
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
Current replView: {
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
Current replView: {
"hidden" : false,
"ismaster" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
Current replView: {
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
},
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:49 [conn16] end connection 127.0.0.1:38515 (13 connections now open)
m31104| Thu Aug 9 07:46:49 [initandlisten] connection accepted from 127.0.0.1:38581 #20 (15 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31104",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
Current replView: {
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
Current replView: {
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31104| Thu Aug 9 07:46:49 [conn12] end connection 127.0.0.1:38473 (13 connections now open)
m31104| Thu Aug 9 07:46:49 [initandlisten] connection accepted from 127.0.0.1:38583 #21 (15 connections now open)
m31104| Thu Aug 9 07:46:50 [conn13] end connection 127.0.0.1:38474 (13 connections now open)
m31104| Thu Aug 9 07:46:50 [initandlisten] connection accepted from 127.0.0.1:38586 #22 (15 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m31104| Thu Aug 9 07:46:50 [conn14] end connection 127.0.0.1:38477 (13 connections now open)
m31104| Thu Aug 9 07:46:50 [initandlisten] connection accepted from 127.0.0.1:38587 #23 (15 connections now open)
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
Current replView: {
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
},
"master" : -1,
"nextSlave" : 0
],
}
m31103| Thu Aug 9 07:46:50 [conn15] end connection 127.0.0.1:52038 (10 connections now open)
m31103| Thu Aug 9 07:46:50 [initandlisten] connection accepted from 127.0.0.1:52148 #21 (12 connections now open)
Thu Aug 9 07:46:50 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
Current replView: {
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
}
"master" : -1,
"nextSlave" : 0
],
}
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
}
],
"master" : -1,
"nextSlave" : 0
Current replView: {
}
m30999| Thu Aug 9 07:46:51 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
"hosts" : [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
Current replView: {
"addr" : "SERVER04:31103",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
"master" : 4,
"nextSlave" : 0
],
----
Removing node, new conf: {
"_id" : "test-rs0",
"version" : 3,
"members" : [
{
"_id" : 1,
"host" : "SERVER04:31101",
"priority" : 1
},
{
"_id" : 2,
"host" : "SERVER04:31102",
"priority" : 1
},
{
"_id" : 3,
"host" : "SERVER04:31103",
"priority" : 1
},
{
"_id" : 4,
"host" : "SERVER04:31104",
"priority" : 100
}
]
}
----
Thu Aug 9 07:46:51 trying reconnect to 127.0.0.1:31100
m31100| Thu Aug 9 07:46:51 [initandlisten] connection accepted from 127.0.0.1:45349 #54 (21 connections now open)
Thu Aug 9 07:46:51 reconnect 127.0.0.1:31100 ok
}
m31104| Thu Aug 9 07:46:51 [conn2] replSet replSetReconfig [2]
m31104| Thu Aug 9 07:46:51 [conn2] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:46:51 [conn2] replSet replSetReconfig config object parses ok, 4 members specified
m31104| Thu Aug 9 07:46:51 [conn2] replSet saveConfigLocally done
Thu Aug 9 07:46:51 DBClientCursor::init call() failed
Expected exception because of reconfig: Error: error doing query: failed
Thu Aug 9 07:46:51 query failed : admin.$cmd { replSetReconfig: { _id: "test-rs0", version: 3.0, members: [ { _id: 1.0, host: "SERVER04:31101", priority: 1.0 }, { _id: 2.0, host: "SERVER04:31102", priority: 1.0 }, { _id: 3.0, host: "SERVER04:31103", priority: 1.0 }, { _id: 4.0, host: "SERVER04:31104", priority: 100.0 } ] } } to: 127.0.0.1:31104
m31102| Thu Aug 9 07:46:51 [conn21] end connection 127.0.0.1:48182 (10 connections now open)
m31100| Thu Aug 9 07:46:51 [conn53] end connection 127.0.0.1:45310 (20 connections now open)
m30999| Thu Aug 9 07:46:51 [WriteBackListener-SERVER04:31104] DBClientCursor::init call() failed
m31100| Thu Aug 9 07:46:51 [conn35] end connection 127.0.0.1:45215 (19 connections now open)
m31100| Thu Aug 9 07:46:51 [conn29] end connection 127.0.0.1:45205 (19 connections now open)
m31100| Thu Aug 9 07:46:51 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m30999| Thu Aug 9 07:46:51 [WriteBackListener-SERVER04:31104] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31103| Thu Aug 9 07:46:51 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31104| Thu Aug 9 07:46:51 [conn2] replSet debug: cleared old tasks 4
m31104| Thu Aug 9 07:46:51 [conn2] replSet SECONDARY
m31104| Thu Aug 9 07:46:51 [conn2] replSet relinquishing primary state
m31104| Thu Aug 9 07:46:51 [conn2] replSet PRIMARY
m31104| Thu Aug 9 07:46:51 [conn2] replSet closing client sockets after relinquishing primary
m31104| Thu Aug 9 07:46:51 [conn2] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:46:51 [conn2] starting rsHealthPoll for SERVER04:31101
m31104| Thu Aug 9 07:46:51 [conn2] replSet replSetReconfig new config saved locally
m31104| Thu Aug 9 07:46:51 [conn2] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38353] 
m31104| Thu Aug 9 07:46:51 [conn1] end connection 127.0.0.1:38352 (13 connections now open)
m31104| Thu Aug 9 07:46:51 [conn2] starting rsHealthPoll for SERVER04:31103
m31104| Thu Aug 9 07:46:51 [initandlisten] connection accepted from 127.0.0.1:38592 #24 (13 connections now open)
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31101
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
m31104| Thu Aug 9 07:46:51 [rsMgr] couldn't find member: 0
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31103
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
m31104| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31104| Thu Aug 9 07:46:51 [conn24] _DEBUG ReadContext db wasn't open, will try to open test.user
m31104| Thu Aug 9 07:46:51 [conn24] opening db: test
m31101| Thu Aug 9 07:46:51 [conn18] end connection 127.0.0.1:42824 (10 connections now open)
m31104| Thu Aug 9 07:46:51 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote
m31103| Thu Aug 9 07:46:51 [conn21] end connection 127.0.0.1:52148 (10 connections now open)
m31104| Thu Aug 9 07:46:51 [conn17] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38565] 
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
current replView: [
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31102| Thu Aug 9 07:46:51 [conn18] end connection 127.0.0.1:48137 (9 connections now open)
m31102| Thu Aug 9 07:46:51 [initandlisten] connection accepted from 127.0.0.1:48232 #22 (11 connections now open)
m31104| Thu Aug 9 07:46:51 [conn19] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38571] 
m31103| Thu Aug 9 07:46:51 [conn18] end connection 127.0.0.1:52095 (9 connections now open)
m31102| Thu Aug 9 07:46:51 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
m30999| Thu Aug 9 07:46:51 [WriteBackListener-SERVER04:31100] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:51 [WriteBackListener-SERVER04:31100] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31101| Thu Aug 9 07:46:51 [conn21] end connection 127.0.0.1:42883 (9 connections now open)
m31102| Thu Aug 9 07:46:51 [conn22] end connection 127.0.0.1:48232 (9 connections now open)
m31104| Thu Aug 9 07:46:51 [conn18] end connection 127.0.0.1:38569 (10 connections now open)
m31100| Thu Aug 9 07:46:51 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet info saving a newer config version to local.system.replset
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet saveConfigLocally done
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet debug: cleared old tasks 4
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet REMOVED
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet info self not present in the repl set configuration:
m31100| Thu Aug 9 07:46:51 [rsMgr] { _id: "test-rs0", version: 3, members: [ { _id: 1, host: "SERVER04:31101" }, { _id: 2, host: "SERVER04:31102" }, { _id: 3, host: "SERVER04:31103" }, { _id: 4, host: "SERVER04:31104", priority: 100.0 } ] }
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet load config ok from self
m31100| Thu Aug 9 07:46:51 [rsMgr] replSet info Couldn't load config yet. Sleeping 20sec and will try again.
m31100| Thu Aug 9 07:46:51 [rsHealthPoll] ERROR: disableNagle failed: errno:9 Bad file descriptor
m31100| Thu Aug 9 07:46:51 [rsHealthPoll] ERROR: SO_KEEPALIVE failed: errno:9 Bad file descriptor
m31104| Thu Aug 9 07:46:51 [conn20] end connection 127.0.0.1:38581 (9 connections now open)
m31100| Thu Aug 9 07:46:51 [rsHealthPoll] ERROR: can't get TCP_KEEPIDLE: errno:9 Bad file descriptor
m31100| Thu Aug 9 07:46:51 [rsHealthPoll] ERROR: can't get TCP_KEEPINTVL: errno:9 Bad file descriptor
m31100| Thu Aug 9 07:46:51 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31100| Thu Aug 9 07:46:51 [conn46] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45270] 
m31100| Thu Aug 9 07:46:51 [conn45] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:45269] 
m31101| Thu Aug 9 07:46:51 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31100
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31101",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
current replView: [
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31100| Thu Aug 9 07:46:51 [conn50] end connection 127.0.0.1:45305 (15 connections now open)
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] DBClientCursor::init call() failed
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet info SERVER04:31100 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 2, pv: 1, checkEmpty: false, from: "SERVER04:31101", $auth: {} }
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31100 is now in state DOWN
m31102| Thu Aug 9 07:46:51 [conn17] end connection 127.0.0.1:48123 (8 connections now open)
m31101| Thu Aug 9 07:46:51 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31101| Thu Aug 9 07:46:51 [rsMgr] replSet info saving a newer config version to local.system.replset
m31101| Thu Aug 9 07:46:51 [rsMgr] replSet saveConfigLocally done
m31101| Thu Aug 9 07:46:51 [rsMgr] replSet debug: cleared old tasks 4
m31101| Thu Aug 9 07:46:51 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31101| Thu Aug 9 07:46:51 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31101| Thu Aug 9 07:46:51 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31101| Thu Aug 9 07:46:51 [rsMgr] replSet replSetReconfig new config saved locally
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31104 is up
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:46:51 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31103 is up
m31101| Thu Aug 9 07:46:51 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:46:51 [initandlisten] connection accepted from 127.0.0.1:48235 #23 (10 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
current replView: [
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31100| Thu Aug 9 07:46:52 [conn51] end connection 127.0.0.1:45308 (14 connections now open)
m31101| Thu Aug 9 07:46:52 [conn16] end connection 127.0.0.1:42822 (8 connections now open)
m31101| Thu Aug 9 07:46:52 [initandlisten] connection accepted from 127.0.0.1:42936 #22 (9 connections now open)
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet info saving a newer config version to local.system.replset
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] DBClientCursor::init call() failed
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet info SERVER04:31100 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 2, pv: 1, checkEmpty: false, from: "SERVER04:31102", $auth: {} }
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet saveConfigLocally done
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31100 is now in state DOWN
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet debug: cleared old tasks 4
m31102| Thu Aug 9 07:46:52 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31102| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31102| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet replSetReconfig new config saved locally
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote
m31102| Thu Aug 9 07:46:52 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31102| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:52 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 3 3
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31103 is up
m31102| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31101 is up
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m30999| Thu Aug 9 07:46:52 [WriteBackListener-SERVER04:31104] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m30999| Thu Aug 9 07:46:52 [WriteBackListener-SERVER04:31104] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:46:52 [WriteBackListener-SERVER04:31104] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:52 [WriteBackListener-SERVER04:31104] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31102| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31104 is up
m31104| Thu Aug 9 07:46:52 [conn15] end connection 127.0.0.1:38510 (8 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
current replView: [
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31100| Thu Aug 9 07:46:52 [conn52] end connection 127.0.0.1:45309 (13 connections now open)
m31101| Thu Aug 9 07:46:52 [conn17] end connection 127.0.0.1:42823 (8 connections now open)
m31101| Thu Aug 9 07:46:52 [initandlisten] connection accepted from 127.0.0.1:42937 #23 (10 connections now open)
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] DBClientCursor::init call() failed
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet saveConfigLocally done
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet info SERVER04:31100 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 2, pv: 1, checkEmpty: false, from: "SERVER04:31103", $auth: {} }
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet debug: cleared old tasks 4
m31103| Thu Aug 9 07:46:52 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31103| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31103| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet replSetReconfig new config saved locally
m31103| Thu Aug 9 07:46:52 [rsMgr] replset msgReceivedNewConfig version: version: 3
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 3 3
m31103| Thu Aug 9 07:46:52 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31103| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31100 is now in state DOWN
m31103| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31104 is up
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31102 is up
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 3 3
m31103| Thu Aug 9 07:46:52 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:46:52 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31103| Thu Aug 9 07:46:52 [rsMgr] replset msgReceivedNewConfig version: version: 3
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
current replView: [
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31104| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:52 ERROR: Client::shutdown not called: rsHealthPoll
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
current replView: [
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
m31101| Thu Aug 9 07:46:53 [initandlisten] connection accepted from 127.0.0.1:42940 #24 (10 connections now open)
m31103| Thu Aug 9 07:46:53 [initandlisten] connection accepted from 127.0.0.1:52164 #22 (10 connections now open)
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:46:53 [initandlisten] connection accepted from 127.0.0.1:48244 #24 (10 connections now open)
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31102 is up
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31100| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:46:53 [rsHealthPoll] replSet member SERVER04:31103 is up
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
current replView: [
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31104",
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31103",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
current replView: [
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31101| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:46:53 ERROR: Client::shutdown not called: rsHealthPoll
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31103",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31102| Thu Aug 9 07:46:54 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:54 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:46:54 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:46:54 [conn44] end connection 127.0.0.1:45264 (12 connections now open)
m30999| Thu Aug 9 07:46:54 [WriteBackListener-SERVER04:31100] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
m30999| Thu Aug 9 07:46:54 [WriteBackListener-SERVER04:31100] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
m30999| Thu Aug 9 07:46:54 [WriteBackListener-SERVER04:31100] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:46:54 [WriteBackListener-SERVER04:31100] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31104| Thu Aug 9 07:46:54 [initandlisten] connection accepted from 127.0.0.1:38608 #25 (9 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
current replView: [
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31103| Thu Aug 9 07:46:54 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:46:54 ERROR: Client::shutdown not called: rsHealthPoll
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
current replView: [
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
current replView: [
"hidden" : false,
"ismaster" : true,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
current replView: [
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
{
"addr" : "SERVER04:31100",
current replView: [
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
current replView: [
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
},
"pingTimeMillis" : 0
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
current replView: [
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
current replView: [
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
current replView: [
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31103| Thu Aug 9 07:46:57 [conn22] end connection 127.0.0.1:52164 (9 connections now open)
m31103| Thu Aug 9 07:46:57 [initandlisten] connection accepted from 127.0.0.1:52175 #23 (11 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
current replView: [
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31102",
},
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
},
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
current replView: [
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
current replView: [
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
{
}
]
{
current replView: [
"addr" : "SERVER04:31100",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31104| Thu Aug 9 07:46:57 [conn21] end connection 127.0.0.1:38583 (8 connections now open)
m31104| Thu Aug 9 07:46:57 [initandlisten] connection accepted from 127.0.0.1:38618 #26 (10 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
m31104| Thu Aug 9 07:46:58 [conn22] end connection 127.0.0.1:38586 (8 connections now open)
m31100| Thu Aug 9 07:46:58 [initandlisten] connection accepted from 127.0.0.1:45378 #55 (13 connections now open)
m31104| Thu Aug 9 07:46:58 [initandlisten] connection accepted from 127.0.0.1:38619 #27 (10 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
current replView: [
"hidden" : false,
"ismaster" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31104| Thu Aug 9 07:46:58 [conn23] end connection 127.0.0.1:38587 (8 connections now open)
m31104| Thu Aug 9 07:46:58 [initandlisten] connection accepted from 127.0.0.1:38622 #28 (10 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
current replView: [
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31104",
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : false,
}
]
m31101| Thu Aug 9 07:46:59 [conn24] end connection 127.0.0.1:42940 (9 connections now open)
m31101| Thu Aug 9 07:46:59 [initandlisten] connection accepted from 127.0.0.1:42962 #25 (11 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
current replView: [
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
{
"addr" : "SERVER04:31100",
current replView: [
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31102| Thu Aug 9 07:46:59 [conn23] end connection 127.0.0.1:48235 (9 connections now open)
m31101| Thu Aug 9 07:47:00 [conn22] end connection 127.0.0.1:42936 (9 connections now open)
m31101| Thu Aug 9 07:47:00 [initandlisten] connection accepted from 127.0.0.1:42965 #26 (11 connections now open)
m31102| Thu Aug 9 07:46:59 [initandlisten] connection accepted from 127.0.0.1:48266 #25 (11 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
current replView: [
"addr" : "SERVER04:31102",
"ismaster" : false,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
]
m31101| Thu Aug 9 07:47:00 [conn23] end connection 127.0.0.1:42937 (9 connections now open)
m31101| Thu Aug 9 07:47:00 [initandlisten] connection accepted from 127.0.0.1:42968 #27 (11 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
]
current replView: [
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m31100| Thu Aug 9 07:47:00 [conn42] end connection 127.0.0.1:45260 (12 connections now open)
m31104| Thu Aug 9 07:47:00 [conn7] end connection 127.0.0.1:38415 (8 connections now open)
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] changing hosts to { 0: "SERVER04:31101", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102" } from test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] erasing host { addr: "SERVER04:31100", isMaster: false, secondary: true, hidden: false, ok: false } from replica set test-rs0
m31104| Thu Aug 9 07:47:00 [initandlisten] connection accepted from 127.0.0.1:38632 #29 (9 connections now open)
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] reconnect SERVER04:31104 ok
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31104
m31104| Thu Aug 9 07:47:00 [conn8] end connection 127.0.0.1:38420 (8 connections now open)
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
Thu Aug 9 07:47:00 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m31104| Thu Aug 9 07:47:00 [initandlisten] connection accepted from 127.0.0.1:38633 #30 (9 connections now open)
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
current replView: [
}
]
{
"addr" : "SERVER04:31100",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
current replView: [
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : true,
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
},
"hidden" : false,
"pingTimeMillis" : 0
"secondary" : false,
}
]
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
m31100| Thu Aug 9 07:47:01 [conn43] end connection 127.0.0.1:45263 (11 connections now open)
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] changing hosts to { 0: "SERVER04:31101", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102" } from test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] erasing host { addr: "SERVER04:31100", isMaster: false, secondary: true, hidden: false, ok: false } from replica set test-rs0
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31104
m31104| Thu Aug 9 07:47:01 [conn9] end connection 127.0.0.1:38439 (8 connections now open)
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] reconnect SERVER04:31104 ok
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38636 #31 (9 connections now open)
m30999| Thu Aug 9 07:47:01 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
m31103| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38637 #32 (10 connections now open)
m31103| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38638 #33 (11 connections now open)
m31103| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31103| Thu Aug 9 07:47:01 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:47:01 [conn33] query has no more but tailable, cursorid: 5518828303176533859
m31100| Thu Aug 9 07:47:01 [conn33] end connection 127.0.0.1:45212 (10 connections now open)
m31104| Thu Aug 9 07:47:01 [conn34] query has no more but tailable, cursorid: 2517498585431770981
m31102| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38639 #34 (12 connections now open)
m31102| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31102| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31104| Thu Aug 9 07:47:01 [conn35] query has no more but tailable, cursorid: 6300565024527452014
m31100| Thu Aug 9 07:47:01 [conn48] end connection 127.0.0.1:45272 (9 connections now open)
m31102| Thu Aug 9 07:47:01 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38640 #35 (13 connections now open)
m31101| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:01 [conn36] query has no more but tailable, cursorid: 6984655260676884336
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38641 #36 (14 connections now open)
m31101| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38642 #37 (15 connections now open)
m31101| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31101| Thu Aug 9 07:47:01 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:47:01 [conn37] query has no more but tailable, cursorid: 1165031757791463281
m31104| Thu Aug 9 07:47:01 [conn38] query has no more but tailable, cursorid: 1665409445073880946
m31100| Thu Aug 9 07:47:01 [conn47] end connection 127.0.0.1:45271 (8 connections now open)
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38643 #38 (16 connections now open)
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 3
}
]
current replView: [
----
"hosts" : {
"SERVER04:29000::0" : {
"available" : 2,
"created" : 2
},
"SERVER04:29000::30" : {
"available" : 2,
"created" : 2
},
"SERVER04:31100::0" : {
"available" : 0,
"created" : 5
},
"SERVER04:31101::0" : {
"available" : 1,
"created" : 2
},
"SERVER04:31102::0" : {
"available" : 1,
"created" : 2
},
"SERVER04:31103::0" : {
"available" : 1,
"created" : 2
},
"SERVER04:31104::0" : {
"available" : 1,
"created" : 4
},
"test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104::0" : {
"available" : 1,
"created" : 1
}
},
"replicaSets" : {
"test-rs0" : {
"hosts" : [
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
{
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 3
}
},
"master" : 3,
"nextSlave" : 0
],
}
"createdByType" : {
"master" : 19,
"set" : 1
},
"totalAvailable" : 9,
"totalCreated" : 20,
"numDBClientConnection" : 20,
"numAScopedConnection" : 8,
"ok" : 1
},
----
----
Put node back, new conf: {
"_id" : "test-rs0",
"version" : 4,
"members" : [
{
"_id" : 0,
"host" : "SERVER04:31100"
},
{
"_id" : 1,
"host" : "SERVER04:31101"
},
{
"_id" : 2,
"host" : "SERVER04:31102"
},
{
}
"_id" : 3,
"host" : "SERVER04:31103"
{
"_id" : 4,
"host" : "SERVER04:31104"
}
},
]
----
m31100| Thu Aug 9 07:47:01 [conn54] end connection 127.0.0.1:45349 (7 connections now open)
Thu Aug 9 07:47:01 Socket recv() errno:104 Connection reset by peer 127.0.0.1:31100
}
Thu Aug 9 07:47:01 DBClientCursor::init call() failed
Thu Aug 9 07:47:01 SocketException: remote: 127.0.0.1:31100 error: 9001 socket exception [1] server [127.0.0.1:31100] 
ReplSetTest Could not call ismaster on node 0
Thu Aug 9 07:47:01 query failed : admin.$cmd { ismaster: 1.0 } to: 127.0.0.1:31100
Thu Aug 9 07:47:01 reconnect 127.0.0.1:31104 ok
m31104| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:38644 #39 (17 connections now open)
m31104| Thu Aug 9 07:47:01 [conn39] replSet replSetReconfig config object parses ok, 5 members specified
m31104| Thu Aug 9 07:47:01 [conn39] replSet cmufcc requestHeartbeat SERVER04:31100 : 9001 socket exception [2] server [127.0.0.1:31100] 
m31104| Thu Aug 9 07:47:01 [conn39] replSet replSetReconfig [2]
m31104| Thu Aug 9 07:47:01 [conn39] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:47:01 [conn39] replSet saveConfigLocally done
m31104| Thu Aug 9 07:47:01 [conn39] replSet debug: cleared old tasks 3
m31104| Thu Aug 9 07:47:01 [conn39] replSet relinquishing primary state
m31104| Thu Aug 9 07:47:01 [conn39] replSet SECONDARY
m31104| Thu Aug 9 07:47:01 [conn39] replSet closing client sockets after relinquishing primary
m31102| Thu Aug 9 07:47:01 [conn24] end connection 127.0.0.1:48244 (9 connections now open)
m31101| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31101| Thu Aug 9 07:47:01 [conn25] end connection 127.0.0.1:42962 (9 connections now open)
m30999| Thu Aug 9 07:47:01 [WriteBackListener-SERVER04:31104] DBClientCursor::init call() failed
Thu Aug 9 07:47:01 trying reconnect to 127.0.0.1:31104
m30999| Thu Aug 9 07:47:01 [WriteBackListener-SERVER04:31104] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31103| Thu Aug 9 07:47:01 [conn23] end connection 127.0.0.1:52175 (9 connections now open)
m31103| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31102| Thu Aug 9 07:47:01 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31102| Thu Aug 9 07:47:01 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31101| Thu Aug 9 07:47:01 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31103| Thu Aug 9 07:47:01 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31104| Thu Aug 9 07:47:01 [conn39] replSet PRIMARY
m31104| Thu Aug 9 07:47:01 [conn37] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38642] 
m31104| Thu Aug 9 07:47:01 [conn39] starting rsHealthPoll for SERVER04:31103
Thu Aug 9 07:47:01 DBClientCursor::init call() failed
Expected exception because of replSetReconfig: Error: error doing query: failed
Thu Aug 9 07:47:01 query failed : admin.$cmd { replSetReconfig: { _id: "test-rs0", version: 4, members: [ { _id: 0, host: "SERVER04:31100" }, { _id: 1, host: "SERVER04:31101" }, { _id: 2, host: "SERVER04:31102" }, { _id: 3, host: "SERVER04:31103" }, { _id: 4, host: "SERVER04:31104" } ] } } to: 127.0.0.1:31104
m31104| Thu Aug 9 07:47:01 [conn33] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38638] 
m31104| Thu Aug 9 07:47:01 [conn34] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38639] 
m31104| Thu Aug 9 07:47:01 [conn39] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:47:01 [conn39] starting rsHealthPoll for SERVER04:31101
Thu Aug 9 07:47:01 trying reconnect to 127.0.0.1:31100
m31104| Thu Aug 9 07:47:01 [conn39] replSet replSetReconfig new config saved locally
m31104| Thu Aug 9 07:47:01 [conn39] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38644] 
m31104| Thu Aug 9 07:47:01 [conn39] starting rsHealthPoll for SERVER04:31100
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31103
m31100| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:45404 #56 (8 connections now open)
m31100| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:45405 #57 (9 connections now open)
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31100 is up
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31101
m31104| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
ReplSetTest Could not call ismaster on node 4
Thu Aug 9 07:47:01 reconnect 127.0.0.1:31100 ok
2012-08-09 07:47:02 EDT	
m31104| Thu Aug 9 07:47:01 [conn35] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38640] 
m31104| Thu Aug 9 07:47:01 [conn36] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38641] 
m31101| Thu Aug 9 07:47:01 [rsMgr] replset msgReceivedNewConfig version: version: 4
m31101| Thu Aug 9 07:47:01 [rsMgr] replSet info saving a newer config version to local.system.replset
m31101| Thu Aug 9 07:47:01 [rsMgr] replSet saveConfigLocally done
m31101| Thu Aug 9 07:47:01 [rsMgr] replSet debug: cleared old tasks 3
m31101| Thu Aug 9 07:47:01 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31101| Thu Aug 9 07:47:01 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31101| Thu Aug 9 07:47:01 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31101| Thu Aug 9 07:47:01 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31101| Thu Aug 9 07:47:01 [rsMgr] replSet replSetReconfig new config saved locally
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31104 is up
m31104| Thu Aug 9 07:47:01 [conn38] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38643] 
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31103 is up
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31100| Thu Aug 9 07:47:01 [initandlisten] connection accepted from 127.0.0.1:45407 #58 (10 connections now open)
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31100 is up
m31101| Thu Aug 9 07:47:01 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31102| Thu Aug 9 07:47:02 [rsMgr] replSet info saving a newer config version to local.system.replset
m31102| Thu Aug 9 07:47:02 [rsMgr] replSet saveConfigLocally done
m31102| Thu Aug 9 07:47:02 [rsMgr] replSet debug: cleared old tasks 3
m31102| Thu Aug 9 07:47:02 [rsMgr] replset msgReceivedNewConfig version: version: 4
m31102| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31102| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31102| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31102| Thu Aug 9 07:47:02 [rsMgr] replSet replSetReconfig new config saved locally
m31102| Thu Aug 9 07:47:02 [rsMgr] replset msgReceivedNewConfig version: version: 4
m31102| Thu Aug 9 07:47:02 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:02 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 4 4
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31104 is up
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31103 is up
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31102| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31100| Thu Aug 9 07:47:02 [initandlisten] connection accepted from 127.0.0.1:45408 #59 (11 connections now open)
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31100 is up
m31102| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:47:02 [rsMgr] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:47:02 [rsMgr] replSet saveConfigLocally done
m31103| Thu Aug 9 07:47:02 [rsMgr] replSet debug: cleared old tasks 3
m31103| Thu Aug 9 07:47:02 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:02 [rsMgr] replset msgReceivedNewConfig version: version: 4
m31103| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31103| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31103| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31100
m31103| Thu Aug 9 07:47:02 [rsMgr] replSet replSetReconfig new config saved locally
m31103| Thu Aug 9 07:47:02 [rsMgr] replset msgReceivedNewConfig version: version: 4
m31103| Thu Aug 9 07:47:02 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 4 4
m31100| Thu Aug 9 07:47:02 [initandlisten] connection accepted from 127.0.0.1:45409 #60 (12 connections now open)
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31104 is up
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31102 is up
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:47:02 [rsHealthPoll] replSet member SERVER04:31100 is up
m31103| Thu Aug 9 07:47:02 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:03 [initandlisten] connection accepted from 127.0.0.1:52212 #24 (10 connections now open)
m31104| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:03 [initandlisten] connection accepted from 127.0.0.1:48292 #26 (10 connections now open)
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31102 is up
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31101| Thu Aug 9 07:47:03 [initandlisten] connection accepted from 127.0.0.1:42991 #28 (10 connections now open)
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31104| Thu Aug 9 07:47:03 [rsHealthPoll] replSet member SERVER04:31103 is up
Thu Aug 9 07:47:03 reconnect 127.0.0.1:31104 ok
Thu Aug 9 07:47:03 trying reconnect to 127.0.0.1:31104
2012-08-09 07:47:10 EDT	
m31104| Thu Aug 9 07:47:03 [initandlisten] connection accepted from 127.0.0.1:38655 #40 (11 connections now open)
m31101| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:47:03 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:04 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:04 ERROR: Client::shutdown not called: rsHealthPoll
m30999| Thu Aug 9 07:47:04 [WriteBackListener-SERVER04:31104] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m31104| Thu Aug 9 07:47:04 [conn32] end connection 127.0.0.1:38637 (10 connections now open)
m30999| Thu Aug 9 07:47:04 [WriteBackListener-SERVER04:31104] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:47:04 [WriteBackListener-SERVER04:31104] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:47:04 [WriteBackListener-SERVER04:31104] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31103| Thu Aug 9 07:47:04 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:04 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:08 [initandlisten] connection accepted from 127.0.0.1:38658 #41 (11 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] changing hosts to { 0: "SERVER04:31101", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102", 4: "SERVER04:31100" } from test-rs0/SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m31104| Thu Aug 9 07:47:10 [conn29] end connection 127.0.0.1:38632 (10 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] successfully connected to new host SERVER04:31100 in replica set test-rs0
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31104
m31100| Thu Aug 9 07:47:10 [initandlisten] connection accepted from 127.0.0.1:45417 #61 (13 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] reconnect SERVER04:31104 ok
m31104| Thu Aug 9 07:47:10 [initandlisten] connection accepted from 127.0.0.1:38660 #42 (11 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] trying to add new host SERVER04:31100 to replica set test-rs0
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m31104| Thu Aug 9 07:47:10 [conn30] end connection 127.0.0.1:38633 (10 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
m31104| Thu Aug 9 07:47:10 [initandlisten] connection accepted from 127.0.0.1:38661 #43 (11 connections now open)
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
Thu Aug 9 07:47:10 [ReplicaSetMonitorWatcher] warning: node: SERVER04:31100 isn't a part of set: test-rs0 ismaster: { ismaster: false, secondary: false, info: "loading local.system.replset config (LOADINGCONFIG)", isreplicaset: true, maxBsonObjectSize: 16777216, localTime: new Date(1344512830671), ok: 1.0 }
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m31104| Thu Aug 9 07:47:11 [conn31] end connection 127.0.0.1:38636 (10 connections now open)
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] changing hosts to { 0: "SERVER04:31101", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102", 4: "SERVER04:31100" } from test-rs0/SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] trying to add new host SERVER04:31100 to replica set test-rs0
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] successfully connected to new host SERVER04:31100 in replica set test-rs0
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] trying reconnect to SERVER04:31104
m31100| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:45422 #62 (14 connections now open)
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] reconnect SERVER04:31104 ok
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38665 #44 (11 connections now open)
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] Primary for replica set test-rs0 changed to SERVER04:31104
m30999| Thu Aug 9 07:47:11 [ReplicaSetMonitorWatcher] warning: node: SERVER04:31100 isn't a part of set: test-rs0 ismaster: { ismaster: false, secondary: false, info: "loading local.system.replset config (LOADINGCONFIG)", isreplicaset: true, maxBsonObjectSize: 16777216, localTime: new Date(1344512831095), ok: 1.0 }
m31100| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:45425 #63 (15 connections now open)
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet load config ok from self
m31100| Thu Aug 9 07:47:11 [rsMgr] trying to contact SERVER04:31101
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet load config couldn't get from SERVER04:31101 socket exception [SEND_ERROR] for 127.0.0.1:31101
m31100| Thu Aug 9 07:47:11 [rsMgr] trying to contact SERVER04:31102
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38666 #45 (12 connections now open)
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet load config ok from SERVER04:31102
m31100| Thu Aug 9 07:47:11 [rsMgr] trying to contact SERVER04:31103
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet load config couldn't get from SERVER04:31103 socket exception [SEND_ERROR] for 127.0.0.1:31103
m31100| Thu Aug 9 07:47:11 [rsMgr] trying to contact SERVER04:31104
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet load config couldn't get from SERVER04:31104 socket exception [SEND_ERROR] for 127.0.0.1:31104
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet I am SERVER04:31100
m31100| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31100| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31100| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31100| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet got config version 4 from a remote, saving locally
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet info saving a newer config version to local.system.replset
m31100| Thu Aug 9 07:47:11 [rsMgr] replSet saveConfigLocally done
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31100| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31100| Thu Aug 9 07:47:11 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is up
m31102| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:48307 #27 (11 connections now open)
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31100| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31100| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:17 5023a309:1
m31104| Thu Aug 9 07:47:11 [conn46] query has no more but tailable, cursorid: 9166807124480994945
m31103| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:52230 #25 (11 connections now open)
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38669 #46 (13 connections now open)
m31101| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:43009 #29 (11 connections now open)
m31100| Thu Aug 9 07:47:11 [rsSync] replSet SECONDARY
m31100| Thu Aug 9 07:47:11 [rsSync] build index local.replset.minvalid { _id: 1 }
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31104 is up
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31101 is up
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is up
m31100| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31100| Thu Aug 9 07:47:11 [rsSync] build index done. scanned 0 total records. 0 secs
m31100| Thu Aug 9 07:47:11 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31100| Thu Aug 9 07:47:11 [rsSyncNotifier] Socket flush send() errno:9 Bad file descriptor 127.0.0.1:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38671 #47 (14 connections now open)
m31100| Thu Aug 9 07:47:11 [rsSyncNotifier] caught exception (socket exception [SEND_ERROR] for 127.0.0.1:31104) in destructor (~PiggyBackData)
m31104| Thu Aug 9 07:47:11 [conn48] query has no more but tailable, cursorid: 6282348032410627719
m31101| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38673 #48 (15 connections now open)
m31101| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31101| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:51 5023a32b:1
m31104| Thu Aug 9 07:47:11 [conn49] query has no more but tailable, cursorid: 5108018774417977008
m31101| Thu Aug 9 07:47:11 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38674 #49 (16 connections now open)
m31103| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38675 #50 (17 connections now open)
m31102| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet syncing to: SERVER04:31104
m31104| Thu Aug 9 07:47:11 [conn50] query has no more but tailable, cursorid: 6674229636000755377
m31103| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31103| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:51 5023a32b:1
m31104| Thu Aug 9 07:47:11 [conn51] query has no more but tailable, cursorid: 7788923285973348018
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38676 #51 (18 connections now open)
m31103| Thu Aug 9 07:47:11 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31102| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet remoteOldestOp: Aug 9 07:46:08 5023a300:1
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38677 #52 (19 connections now open)
m31102| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet lastOpTimeFetched: Aug 9 07:46:51 5023a32b:1
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38678 #53 (20 connections now open)
m31104| Thu Aug 9 07:47:11 [conn52] query has no more but tailable, cursorid: 3412819466431868595
m31104| Thu Aug 9 07:47:11 [conn53] query has no more but tailable, cursorid: 7492415232236957364
m31102| Thu Aug 9 07:47:11 [conn26] end connection 127.0.0.1:48292 (10 connections now open)
m31102| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:48318 #28 (12 connections now open)
m31102| Thu Aug 9 07:47:11 [rsSyncNotifier] replset setting oplog notifier to SERVER04:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38680 #54 (21 connections now open)
m31104| Thu Aug 9 07:47:11 [conn54] query has no more but tailable, cursorid: 3846075155704295096
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
current replView: [
"ismaster" : true,
"hidden" : false,
"ok" : true,
"pingTimeMillis" : 3
"secondary" : false,
{
"addr" : "SERVER04:31100",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
},
----
Iteration to remove node 3/4
----
]
----
"_id" : "test-rs0",
"version" : 5,
"members" : [
{
"_id" : 0,
"host" : "SERVER04:31100",
"priority" : 1
},
{
"_id" : 1,
"host" : "SERVER04:31101",
"priority" : 1
},
{
"_id" : 2,
"host" : "SERVER04:31102",
"priority" : 1
},
{
"_id" : 3,
"host" : "SERVER04:31103",
"priority" : 1
},
{
"_id" : 4,
"host" : "SERVER04:31104",
"priority" : 100
}
]
Changing conf to {
}
m31104| Thu Aug 9 07:47:11 [conn40] replSet replSetReconfig config object parses ok, 5 members specified
m31104| Thu Aug 9 07:47:11 [conn40] replSet replSetReconfig [2]
m31104| Thu Aug 9 07:47:11 [conn40] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:47:11 [conn40] replSet saveConfigLocally done
m31104| Thu Aug 9 07:47:11 [conn40] replSet debug: cleared old tasks 4
----
m31102| Thu Aug 9 07:47:11 [conn28] end connection 127.0.0.1:48318 (10 connections now open)
m31102| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31101| Thu Aug 9 07:47:11 [conn28] end connection 127.0.0.1:42991 (10 connections now open)
m31100| Thu Aug 9 07:47:11 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31100| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31101| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31101| Thu Aug 9 07:47:11 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31103| Thu Aug 9 07:47:11 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: SERVER04:31104
m31103| Thu Aug 9 07:47:11 [conn24] end connection 127.0.0.1:52212 (10 connections now open)
m30999| Thu Aug 9 07:47:11 [WriteBackListener-SERVER04:31104] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:47:11 [WriteBackListener-SERVER04:31104] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31102| Thu Aug 9 07:47:11 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
m31103| Thu Aug 9 07:47:11 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: SERVER04:31104
Thu Aug 9 07:47:11 DBClientCursor::init call() failed
Thu Aug 9 07:47:11 query failed : admin.$cmd { replSetReconfig: { _id: "test-rs0", version: 5.0, members: [ { _id: 0.0, host: "SERVER04:31100", priority: 1.0 }, { _id: 1.0, host: "SERVER04:31101", priority: 1.0 }, { _id: 2.0, host: "SERVER04:31102", priority: 1.0 }, { _id: 3.0, host: "SERVER04:31103", priority: 1.0 }, { _id: 4.0, host: "SERVER04:31104", priority: 100.0 } ] } } to: 127.0.0.1:31104
m31100| Thu Aug 9 07:47:11 [conn57] end connection 127.0.0.1:45405 (14 connections now open)
m31104| Thu Aug 9 07:47:11 [conn40] replSet relinquishing primary state
m31104| Thu Aug 9 07:47:11 [conn40] replSet SECONDARY
m31104| Thu Aug 9 07:47:11 [conn40] replSet closing client sockets after relinquishing primary
m31104| Thu Aug 9 07:47:11 [conn40] replSet PRIMARY
m31104| Thu Aug 9 07:47:11 [conn40] starting rsHealthPoll for SERVER04:31103
m31104| Thu Aug 9 07:47:11 [conn40] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:47:11 [conn40] starting rsHealthPoll for SERVER04:31101
m31104| Thu Aug 9 07:47:11 [conn40] starting rsHealthPoll for SERVER04:31100
m31104| Thu Aug 9 07:47:11 [conn40] replSet replSetReconfig new config saved locally
m31104| Thu Aug 9 07:47:11 [conn40] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38655] 
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31100 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31100
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31100 is now in state DOWN
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31104| Thu Aug 9 07:47:11 [conn53] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38678] 
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31104| Thu Aug 9 07:47:11 [conn52] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38677] 
m31101| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:43019 #30 (11 connections now open)
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
Expected exception because of reconfigError: error doing query: failed
m31104| Thu Aug 9 07:47:11 [conn54] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38680] 
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31103
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
"hosts" : [
{
"addr" : "SERVER04:31101",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31102",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31103",
"ok" : true,
"ismaster" : false,
"hidden" : false,
"secondary" : true,
"pingTimeMillis" : 0
},
{
"addr" : "SERVER04:31104",
"ok" : true,
"ismaster" : true,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 3
},
{
"addr" : "SERVER04:31100",
"ok" : false,
"ismaster" : false,
"hidden" : false,
"secondary" : false,
"pingTimeMillis" : 0
}
],
"master" : 3,
"nextSlave" : 0
Current replView: {
----
}
"_id" : "test-rs0",
"version" : 6,
"members" : [
{
"_id" : 1,
"host" : "SERVER04:31101",
"priority" : 1
},
{
"_id" : 2,
"host" : "SERVER04:31102",
"priority" : 1
},
{
"_id" : 3,
"host" : "SERVER04:31103",
"priority" : 1
},
{
"_id" : 4,
"host" : "SERVER04:31104",
"priority" : 100
}
]
Removing node, new conf: {
----
Thu Aug 9 07:47:11 trying reconnect to 127.0.0.1:31104
m31104| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:38683 #55 (18 connections now open)
Thu Aug 9 07:47:11 reconnect 127.0.0.1:31104 ok
m31104| Thu Aug 9 07:47:11 [conn55] replSet replSetReconfig config object parses ok, 4 members specified
m31102| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:48323 #29 (11 connections now open)
m31104| Thu Aug 9 07:47:11 [conn46] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38669] 
m31103| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:52245 #26 (11 connections now open)
m31104| Thu Aug 9 07:47:11 [conn55] replSet replSetReconfig [2]
m31104| Thu Aug 9 07:47:11 [conn55] replSet info saving a newer config version to local.system.replset
m31104| Thu Aug 9 07:47:11 [conn55] replSet saveConfigLocally done
m31104| Thu Aug 9 07:47:11 [conn55] replSet debug: cleared old tasks 4
m31104| Thu Aug 9 07:47:11 [conn55] replSet relinquishing primary state
m31104| Thu Aug 9 07:47:11 [conn55] replSet SECONDARY
}
m31102| Thu Aug 9 07:47:11 [conn29] end connection 127.0.0.1:48323 (10 connections now open)
m31101| Thu Aug 9 07:47:11 [conn30] end connection 127.0.0.1:43019 (10 connections now open)
m31103| Thu Aug 9 07:47:11 [conn26] end connection 127.0.0.1:52245 (10 connections now open)
m31104| Thu Aug 9 07:47:11 [conn55] replSet PRIMARY
m31104| Thu Aug 9 07:47:11 [conn55] replSet closing client sockets after relinquishing primary
m31104| Thu Aug 9 07:47:11 [conn55] starting rsHealthPoll for SERVER04:31102
m31104| Thu Aug 9 07:47:11 [conn55] starting rsHealthPoll for SERVER04:31101
m31104| Thu Aug 9 07:47:11 [conn55] replSet replSetReconfig new config saved locally
m31104| Thu Aug 9 07:47:11 [conn55] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38683] 
m31104| Thu Aug 9 07:47:11 [conn55] starting rsHealthPoll for SERVER04:31103
Thu Aug 9 07:47:11 DBClientCursor::init call() failed
Expected exception because of reconfig: Error: error doing query: failed
m31104| Thu Aug 9 07:47:11 [conn55] thread conn55 stack usage was 19960 bytes, which is the most so far
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31102
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31103
m30999| Thu Aug 9 07:47:11 [conn1] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
Thu Aug 9 07:47:11 query failed : admin.$cmd { replSetReconfig: { _id: "test-rs0", version: 6.0, members: [ { _id: 1.0, host: "SERVER04:31101", priority: 1.0 }, { _id: 2.0, host: "SERVER04:31102", priority: 1.0 }, { _id: 3.0, host: "SERVER04:31103", priority: 1.0 }, { _id: 4.0, host: "SERVER04:31104", priority: 100.0 } ] } } to: 127.0.0.1:31104
m30999| Thu Aug 9 07:47:11 [conn1] DBClientCursor::init lazy say() failed
m30999| Thu Aug 9 07:47:11 [conn1] DBClientCursor::init message from say() was empty
m30999| Thu Aug 9 07:47:11 [conn1] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:47:11 [conn1] got not master for: SERVER04:31104
m30999| Thu Aug 9 07:47:11 [conn1] warning: db exception when finishing on test-rs0:test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104, current connection state is { state: { conn: "test-rs0/SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104,SERVER04:31100", vinfo: "test-rs0:test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104", cursor: "(empty)", count: 0, done: false }, retryNext: false, init: true, finish: true, errored: false } :: caused by :: 15988 error querying server
m31104| Thu Aug 9 07:47:11 [conn24] end connection 127.0.0.1:38592 (15 connections now open)
query error, try again: error: { "$err" : "error querying server", "code" : 15988 }
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): socket exception [SEND_ERROR] for 127.0.0.1:31101
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
m30999| Thu Aug 9 07:47:11 [conn1] Socket recv() errno:104 Connection reset by peer 127.0.0.1:31104
m30999| Thu Aug 9 07:47:11 [conn1] SocketException: remote: 127.0.0.1:31104 error: 9001 socket exception [1] server [127.0.0.1:31104] 
m30999| Thu Aug 9 07:47:11 [conn1] DBClientCursor::init call() failed
m31104| Thu Aug 9 07:47:11 [conn44] end connection 127.0.0.1:38665 (14 connections now open)
m31100| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:45444 #64 (15 connections now open)
m31104| Thu Aug 9 07:47:11 [conn50] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38675] 
m31104| Thu Aug 9 07:47:11 [conn51] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38676] 
m31104| Thu Aug 9 07:47:11 [conn49] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38674] 
m31104| Thu Aug 9 07:47:11 [conn48] SocketException handling request, closing client connection: 9001 socket exception [2] server [127.0.0.1:38673] 
m31104| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
m31103| Thu Aug 9 07:47:11 [conn19] end connection 127.0.0.1:52098 (9 connections now open)
m31101| Thu Aug 9 07:47:11 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31101| Thu Aug 9 07:47:11 [rsMgr] replSet info saving a newer config version to local.system.replset
m31101| Thu Aug 9 07:47:11 [rsMgr] replSet saveConfigLocally done
m31101| Thu Aug 9 07:47:11 [rsMgr] replSet debug: cleared old tasks 4
m31101| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31101| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31101| Thu Aug 9 07:47:11 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31101| Thu Aug 9 07:47:11 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:47:11 [rsMgr] replSet replSetReconfig new config saved locally
m31101| Thu Aug 9 07:47:11 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31104 is up
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31101| Thu Aug 9 07:47:11 [rsMgr] couldn't find member: 0
m31102| Thu Aug 9 07:47:11 [conn25] end connection 127.0.0.1:48266 (9 connections now open)
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is up
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:48328 #30 (11 connections now open)
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is up
m31101| Thu Aug 9 07:47:11 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:47:11 [initandlisten] connection accepted from 127.0.0.1:52248 #27 (11 connections now open)
m31103| Thu Aug 9 07:47:12 [conn20] end connection 127.0.0.1:52099 (9 connections now open)
m31102| Thu Aug 9 07:47:12 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31102| Thu Aug 9 07:47:12 [rsMgr] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:47:12 [initandlisten] connection accepted from 127.0.0.1:52250 #28 (11 connections now open)
m31102| Thu Aug 9 07:47:12 [rsMgr] replSet debug: cleared old tasks 4
m31102| Thu Aug 9 07:47:12 [rsMgr] replSet saveConfigLocally done
m31102| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31103
m31102| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31102| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31102| Thu Aug 9 07:47:12 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:12 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:12 ERROR: Client::shutdown not called: rsHealthPoll
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31103 is up
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31104 is up
m31101| Thu Aug 9 07:47:12 [conn26] end connection 127.0.0.1:42965 (9 connections now open)
m31101| Thu Aug 9 07:47:12 [initandlisten] connection accepted from 127.0.0.1:43028 #31 (10 connections now open)
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31101 is up
m31102| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31102| Thu Aug 9 07:47:12 [rsMgr] not electing self, we are not freshest
m31102| Thu Aug 9 07:47:12 [rsMgr] not electing self, we are not freshest
m30999| Thu Aug 9 07:47:12 [conn1] ReplicaSetMonitor::_checkConnection: SERVER04:31101 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31101", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102" ], primary: "SERVER04:31104", me: "SERVER04:31101", maxBsonObjectSize: 16777216, localTime: new Date(1344512832195), ok: 1.0 }
m30999| Thu Aug 9 07:47:12 [conn1] changing hosts to { 0: "SERVER04:31101", 1: "SERVER04:31104", 2: "SERVER04:31103", 3: "SERVER04:31102" } from test-rs0/SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104,SERVER04:31100
m31100| Thu Aug 9 07:47:12 [conn62] end connection 127.0.0.1:45422 (14 connections now open)
m30999| Thu Aug 9 07:47:12 [conn1] erasing host { addr: "SERVER04:31100", isMaster: false, secondary: true, hidden: false, ok: true } from replica set test-rs0
m30999| Thu Aug 9 07:47:12 [conn1] ReplicaSetMonitor::_checkConnection: SERVER04:31102 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31102", "SERVER04:31104", "SERVER04:31103", "SERVER04:31101" ], primary: "SERVER04:31104", me: "SERVER04:31102", maxBsonObjectSize: 16777216, localTime: new Date(1344512832197), ok: 1.0 }
m31102| Thu Aug 9 07:47:12 [rsMgr] replSet replSetReconfig new config saved locally
m30999| Thu Aug 9 07:47:12 [conn1] ReplicaSetMonitor::_checkConnection: SERVER04:31103 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31103", "SERVER04:31104", "SERVER04:31102", "SERVER04:31101", "SERVER04:31100" ], primary: "SERVER04:31104", me: "SERVER04:31103", maxBsonObjectSize: 16777216, localTime: new Date(1344512832197), ok: 1.0 }
m30999| Thu Aug 9 07:47:12 [conn1] changing hosts to { 0: "SERVER04:31103", 1: "SERVER04:31104", 2: "SERVER04:31102", 3: "SERVER04:31101", 4: "SERVER04:31100" } from test-rs0/SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:47:12 [conn1] trying to add new host SERVER04:31100 to replica set test-rs0
m30999| Thu Aug 9 07:47:12 [conn1] successfully connected to new host SERVER04:31100 in replica set test-rs0
m30999| Thu Aug 9 07:47:12 [conn1] ReplicaSetMonitor::_checkConnection: caught exception SERVER04:31104 socket exception [FAILED_STATE] for SERVER04:31104
m30999| Thu Aug 9 07:47:12 [conn1] ReplicaSetMonitor::_checkConnection: SERVER04:31100 { setName: "test-rs0", ismaster: false, secondary: true, hosts: [ "SERVER04:31100", "SERVER04:31104", "SERVER04:31103", "SERVER04:31102", "SERVER04:31101" ], primary: "SERVER04:31104", me: "SERVER04:31100", maxBsonObjectSize: 16777216, localTime: new Date(1344512832198), ok: 1.0 }
m31100| Thu Aug 9 07:47:12 [initandlisten] connection accepted from 127.0.0.1:45452 #65 (15 connections now open)
m31103| Thu Aug 9 07:47:12 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31100 is now in state SECONDARY
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet info saving a newer config version to local.system.replset
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet debug: cleared old tasks 4
m31102| Thu Aug 9 07:47:12 [conn20] end connection 127.0.0.1:48181 (9 connections now open)
m31102| Thu Aug 9 07:47:12 [initandlisten] connection accepted from 127.0.0.1:48334 #31 (11 connections now open)
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet saveConfigLocally done
m31103| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31102
m31103| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31101
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet replSetReconfig new config saved locally
m31103| Thu Aug 9 07:47:12 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 6 6
m31101| Thu Aug 9 07:47:12 [conn27] end connection 127.0.0.1:42968 (9 connections now open)
m31103| Thu Aug 9 07:47:12 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31103| Thu Aug 9 07:47:12 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 6 6
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31102 is up
m31103| Thu Aug 9 07:47:12 [rsMgr] starting rsHealthPoll for SERVER04:31104
m31103| Thu Aug 9 07:47:12 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31104 is now in state PRIMARY
m31101| Thu Aug 9 07:47:12 [initandlisten] connection accepted from 127.0.0.1:43033 #32 (10 connections now open)
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31101 is up
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m31100| Thu Aug 9 07:47:13 [rsMgr] replset msgReceivedNewConfig version: version: 6
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet info saving a newer config version to local.system.replset
m31102| Thu Aug 9 07:47:13 [conn27] end connection 127.0.0.1:48307 (9 connections now open)
m31103| Thu Aug 9 07:47:12 [rsHealthPoll] replSet member SERVER04:31104 is up
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet saveConfigLocally done
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet debug: cleared old tasks 4
m31100| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:47:13 [rsHealthPoll] DBClientCursor::init call() failed
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet REMOVED
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet info self not present in the repl set configuration:
m31100| Thu Aug 9 07:47:13 [rsHealthPoll] replSet info SERVER04:31104 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31104 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 4, pv: 1, checkEmpty: false, from: "SERVER04:31100", $auth: {} }
m31100| Thu Aug 9 07:47:13 [rsMgr] { _id: "test-rs0", version: 6, members: [ { _id: 1, host: "SERVER04:31101" }, { _id: 2, host: "SERVER04:31102" }, { _id: 3, host: "SERVER04:31103" }, { _id: 4, host: "SERVER04:31104", priority: 100.0 } ] }
m31104| Thu Aug 9 07:47:13 [conn47] end connection 127.0.0.1:38671 (9 connections now open)
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet load config ok from self
m31100| Thu Aug 9 07:47:13 [conn63] end connection 127.0.0.1:45425 (14 connections now open)
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet load config couldn't get from SERVER04:31101 socket exception [SEND_ERROR] for 127.0.0.1:31101
m31100| Thu Aug 9 07:47:13 [rsMgr] trying to contact SERVER04:31101
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet load config couldn't get from SERVER04:31102 socket exception [SEND_ERROR] for 127.0.0.1:31102
m31100| Thu Aug 9 07:47:13 [rsMgr] trying to contact SERVER04:31102
m31100| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:47:13 [rsMgr] trying to contact SERVER04:31103
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet load config couldn't get from SERVER04:31103 socket exception [SEND_ERROR] for 127.0.0.1:31103
m31100| Thu Aug 9 07:47:13 [rsMgr] trying to contact SERVER04:31104
m30999| Thu Aug 9 07:47:13 [WriteBackListener-SERVER04:31100] DBClientCursor::init call() failed
m30999| Thu Aug 9 07:47:13 [WriteBackListener-SERVER04:31100] WriteBackListener exception : DBClientBase::findN: transport error: SERVER04:31100 ns: admin.$cmd query: { writebacklisten: ObjectId('5023a30896b48f4e35e89db4') }
m31101| Thu Aug 9 07:47:13 [conn29] end connection 127.0.0.1:43009 (9 connections now open)
m31103| Thu Aug 9 07:47:13 [conn25] end connection 127.0.0.1:52230 (9 connections now open)
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet load config ok from SERVER04:31104
m31100| Thu Aug 9 07:47:13 [rsMgr] replSet info Couldn't load config yet. Sleeping 20sec and will try again.
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:13 [initandlisten] connection accepted from 127.0.0.1:38697 #56 (10 connections now open)
m31102| Thu Aug 9 07:47:13 [initandlisten] connection accepted from 127.0.0.1:48337 #32 (10 connections now open)
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31102 is now in state SECONDARY
m31103| Thu Aug 9 07:47:13 [initandlisten] connection accepted from 127.0.0.1:52259 #29 (10 connections now open)
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31102 is up
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31103 is now in state SECONDARY
m31101| Thu Aug 9 07:47:13 [initandlisten] connection accepted from 127.0.0.1:43037 #33 (10 connections now open)
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31101 is up
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31101 is now in state SECONDARY
m30999| Thu Aug 9 07:47:13 [conn1] warning: No primary detected for set test-rs0
m30999| Thu Aug 9 07:47:13 [conn1] warning: socket exception when initializing on test-rs0:test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104, current connection state is { state: { conn: "", vinfo: "test-rs0:test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 11002 socket exception [6] server [test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104] mongos shardconnection connectionpool error: connect failed to set test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m30999| Thu Aug 9 07:47:13 [conn1] DBException in process: socket exception [CONNECT_ERROR] for test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104
m31104| Thu Aug 9 07:47:13 [rsHealthPoll] replSet member SERVER04:31103 is up
"$err" : "socket exception [CONNECT_ERROR] for test-rs0/SERVER04:31100,SERVER04:31101,SERVER04:31102,SERVER04:31103,SERVER04:31104",
"code" : 11002
Thu Aug 9 07:47:13 uncaught exception: error: {
}
failed to load: /home/yellow/buildslave/Linux_64bit_DEBUG/mongo/jstests/slowNightly/repl_monitor_stress.js
2012-08-09 07:47:15 EDT	
m29000| Thu Aug 9 07:47:13 got signal 15 (Terminated), will terminate after current cmd ends
m29000| Thu Aug 9 07:47:13 [interruptThread] now exiting
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: going to close listening sockets...
m29000| Thu Aug 9 07:47:13 [interruptThread] closing listening socket: 62
m29000| Thu Aug 9 07:47:13 [interruptThread] closing listening socket: 63
m29000| Thu Aug 9 07:47:13 [interruptThread] closing listening socket: 64
m29000| Thu Aug 9 07:47:13 [interruptThread] removing socket file: /tmp/mongodb-29000.sock
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: going to flush diaglog...
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: going to close sockets...
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: waiting for fs preallocator...
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: lock for final commit...
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: final commit...
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: closing all files...
m29000| Thu Aug 9 07:47:13 [interruptThread] closeAllFiles() finished
m29000| Thu Aug 9 07:47:13 dbexit: 
m29000| Thu Aug 9 07:47:13 [interruptThread] journalCleanup...
m29000| Thu Aug 9 07:47:13 [interruptThread] removeJournalFiles
m29000| Thu Aug 9 07:47:13 [interruptThread] shutdown: removing fs lock...
m29000| Thu Aug 9 07:47:13 [interruptThread] thread interruptThread stack usage was 10380 bytes, which is the most so far
m29000| Thu Aug 9 07:47:13 dbexit: really exiting now
m31101| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m31101| Thu Aug 9 07:47:13 ERROR: Client::shutdown not called: rsHealthPoll
m30999| Thu Aug 9 07:47:14 [mongosMain] dbexit: received signal 15 rc:0 received signal 15
m31102| Thu Aug 9 07:47:14 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:47:14 [conn65] end connection 127.0.0.1:45452 (13 connections now open)
m31101| Thu Aug 9 07:47:14 [conn13] end connection 127.0.0.1:42773 (9 connections now open)
m31100| Thu Aug 9 07:47:14 [conn64] end connection 127.0.0.1:45444 (12 connections now open)
m31100| Thu Aug 9 07:47:14 [conn28] end connection 127.0.0.1:45204 (12 connections now open)
m31102| Thu Aug 9 07:47:14 [conn13] end connection 127.0.0.1:48076 (9 connections now open)
m31103| Thu Aug 9 07:47:14 [conn12] end connection 127.0.0.1:51998 (9 connections now open)
m31101| Thu Aug 9 07:47:14 [conn20] end connection 127.0.0.1:42844 (8 connections now open)
m31102| Thu Aug 9 07:47:14 [conn19] end connection 127.0.0.1:48147 (8 connections now open)
m31103| Thu Aug 9 07:47:14 [conn17] end connection 127.0.0.1:52069 (8 connections now open)
m31103| Thu Aug 9 07:47:14 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:14 ERROR: Client::shutdown not called: rsHealthPoll
m31103| Thu Aug 9 07:47:14 ERROR: Client::shutdown not called: rsHealthPoll
m31100| Thu Aug 9 07:47:15 ERROR: Client::shutdown not called: rsHealthPoll
m31104| Thu Aug 9 07:47:14 [conn45] end connection 127.0.0.1:38666 (9 connections now open)
m31101| Thu Aug 9 07:47:15 [conn33] end connection 127.0.0.1:43037 (7 connections now open)
m31100| Thu Aug 9 07:47:15 got signal 15 (Terminated), will terminate after current cmd ends
m31100| Thu Aug 9 07:47:15 [interruptThread] now exiting
m31100| Thu Aug 9 07:47:15 dbexit: 
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: going to close listening sockets...
m31101| Thu Aug 9 07:47:15 [initandlisten] connection accepted from 127.0.0.1:43038 #34 (9 connections now open)
m31100| Thu Aug 9 07:47:15 [interruptThread] closing listening socket: 36
m31100| Thu Aug 9 07:47:15 [interruptThread] closing listening socket: 37
m31100| Thu Aug 9 07:47:15 [interruptThread] closing listening socket: 38
m31100| Thu Aug 9 07:47:15 [interruptThread] removing socket file: /tmp/mongodb-31100.sock
m31104| Thu Aug 9 07:47:15 [conn56] end connection 127.0.0.1:38697 (8 connections now open)
2012-08-09 07:47:17 EDT	
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: going to close sockets...
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: going to flush diaglog...
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: lock for final commit...
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: waiting for fs preallocator...
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: final commit...
m31100| Thu Aug 9 07:47:15 [interruptThread] closeAllFiles() finished
m31100| Thu Aug 9 07:47:15 [interruptThread] journalCleanup...
m31100| Thu Aug 9 07:47:15 [interruptThread] removeJournalFiles
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: closing all files...
m31100| Thu Aug 9 07:47:15 [interruptThread] shutdown: removing fs lock...
m31100| Thu Aug 9 07:47:15 dbexit: really exiting now
m31101| Thu Aug 9 07:47:16 [interruptThread] now exiting
m31101| Thu Aug 9 07:47:16 dbexit: 
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: going to close listening sockets...
m31101| Thu Aug 9 07:47:16 [interruptThread] closing listening socket: 39
m31101| Thu Aug 9 07:47:16 [interruptThread] closing listening socket: 40
m31101| Thu Aug 9 07:47:16 [interruptThread] closing listening socket: 41
m31101| Thu Aug 9 07:47:16 [interruptThread] removing socket file: /tmp/mongodb-31101.sock
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: going to flush diaglog...
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: going to close sockets...
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: waiting for fs preallocator...
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: lock for final commit...
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: final commit...
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: closing all files...
m31101| Thu Aug 9 07:47:16 [interruptThread] closeAllFiles() finished
m31101| Thu Aug 9 07:47:16 [interruptThread] journalCleanup...
m31101| Thu Aug 9 07:47:16 [interruptThread] removeJournalFiles
m31101| Thu Aug 9 07:47:16 got signal 15 (Terminated), will terminate after current cmd ends
m31102| Thu Aug 9 07:47:16 [conn30] end connection 127.0.0.1:48328 (7 connections now open)
m31101| Thu Aug 9 07:47:16 [conn1] end connection 127.0.0.1:42678 (7 connections now open)
m31103| Thu Aug 9 07:47:16 [conn27] end connection 127.0.0.1:52248 (7 connections now open)
m31101| Thu Aug 9 07:47:16 [interruptThread] shutdown: removing fs lock...
m31101| Thu Aug 9 07:47:16 dbexit: really exiting now
m31103| Thu Aug 9 07:47:16 [rsHealthPoll] DBClientCursor::init call() failed
m31103| Thu Aug 9 07:47:16 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31101 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 6, pv: 1, checkEmpty: false, from: "SERVER04:31103", $auth: {} }
m31103| Thu Aug 9 07:47:16 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
m31104| Thu Aug 9 07:47:16 [conn26] end connection 127.0.0.1:38618 (7 connections now open)
m31104| Thu Aug 9 07:47:17 [rsHealthPoll] DBClientCursor::init call() failed
m31104| Thu Aug 9 07:47:17 [rsHealthPoll] replSet info SERVER04:31101 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31101 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 6, pv: 1, checkEmpty: false, from: "SERVER04:31104", $auth: {} }
m31102| Thu Aug 9 07:47:17 got signal 15 (Terminated), will terminate after current cmd ends
m31102| Thu Aug 9 07:47:17 [interruptThread] now exiting
m31102| Thu Aug 9 07:47:17 dbexit: 
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: going to close listening sockets...
m31102| Thu Aug 9 07:47:17 [interruptThread] closing listening socket: 42
m31102| Thu Aug 9 07:47:17 [interruptThread] closing listening socket: 43
m31102| Thu Aug 9 07:47:17 [interruptThread] closing listening socket: 44
m31102| Thu Aug 9 07:47:17 [interruptThread] removing socket file: /tmp/mongodb-31102.sock
m31104| Thu Aug 9 07:47:17 [rsHealthPoll] replSet member SERVER04:31101 is now in state DOWN
2012-08-09 07:47:19 EDT	
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: going to flush diaglog...
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: going to close sockets...
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: lock for final commit...
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: final commit...
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: closing all files...
m31102| Thu Aug 9 07:47:17 [interruptThread] closeAllFiles() finished
m31102| Thu Aug 9 07:47:17 [interruptThread] journalCleanup...
m31102| Thu Aug 9 07:47:17 [interruptThread] removeJournalFiles
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: waiting for fs preallocator...
m31103| Thu Aug 9 07:47:17 [conn28] end connection 127.0.0.1:52250 (6 connections now open)
m31104| Thu Aug 9 07:47:17 [conn27] end connection 127.0.0.1:38619 (6 connections now open)
m31102| Thu Aug 9 07:47:17 [conn1] end connection 127.0.0.1:47983 (6 connections now open)
m31102| Thu Aug 9 07:47:17 [interruptThread] shutdown: removing fs lock...
m31102| Thu Aug 9 07:47:17 dbexit: really exiting now
m31103| Thu Aug 9 07:47:18 [interruptThread] now exiting
m31103| Thu Aug 9 07:47:18 dbexit: 
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: going to close listening sockets...
m31103| Thu Aug 9 07:47:18 [interruptThread] closing listening socket: 45
m31103| Thu Aug 9 07:47:18 [interruptThread] closing listening socket: 46
m31103| Thu Aug 9 07:47:18 [interruptThread] closing listening socket: 47
m31103| Thu Aug 9 07:47:18 [interruptThread] removing socket file: /tmp/mongodb-31103.sock
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: going to flush diaglog...
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: going to close sockets...
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: waiting for fs preallocator...
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: lock for final commit...
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: final commit...
m31103| Thu Aug 9 07:47:18 [conn1] end connection 127.0.0.1:51907 (5 connections now open)
m31103| Thu Aug 9 07:47:18 got signal 15 (Terminated), will terminate after current cmd ends
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: closing all files...
m31103| Thu Aug 9 07:47:18 [interruptThread] closeAllFiles() finished
m31103| Thu Aug 9 07:47:18 [interruptThread] journalCleanup...
m31103| Thu Aug 9 07:47:18 [interruptThread] removeJournalFiles
m31103| Thu Aug 9 07:47:18 [interruptThread] shutdown: removing fs lock...
m31103| Thu Aug 9 07:47:18 dbexit: really exiting now
m31104| Thu Aug 9 07:47:18 [conn28] end connection 127.0.0.1:38622 (5 connections now open)
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] DBClientCursor::init call() failed
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] replSet info SERVER04:31102 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31102 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 6, pv: 1, checkEmpty: false, from: "SERVER04:31104", $auth: {} }
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] DBClientCursor::init call() failed
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] replSet info SERVER04:31103 is down (or slow to respond): DBClientBase::findN: transport error: SERVER04:31103 ns: admin.$cmd query: { replSetHeartbeat: "test-rs0", v: 6, pv: 1, checkEmpty: false, from: "SERVER04:31104", $auth: {} }
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] replSet member SERVER04:31102 is now in state DOWN
m31104| Thu Aug 9 07:47:19 [rsHealthPoll] replSet member SERVER04:31103 is now in state DOWN
m31104| Thu Aug 9 07:47:19 [interruptThread] now exiting
m31104| Thu Aug 9 07:47:19 dbexit: 
m31104| Thu Aug 9 07:47:19 [interruptThread] shutdown: going to close listening sockets...
m31104| Thu Aug 9 07:47:19 [interruptThread] closing listening socket: 48
m31104| Thu Aug 9 07:47:19 [interruptThread] closing listening socket: 49
m31104| Thu Aug 9 07:47:19 got signal 15 (Terminated), will terminate after current cmd ends
Thu Aug 9 07:47:20 [conn35] end connection 127.0.0.1:48705 (12 connections now open)
m31104| Thu Aug 9 07:47:19 [interruptThread] cl
Thu Aug 9 07:47:20 [interruptThread] now exiting
Thu Aug 9 07:47:20 dbexit: 
Thu Aug 9 07:47:20 [interruptThread] shutdown: going to close listening sockets...
Thu Aug 9 07:47:20 [interruptThread] closing listening socket: 19
Thu Aug 9 07:47:20 [interruptThread] closing listening socket: 20
Thu Aug 9 07:47:20 [interruptThread] closing listening socket: 21
Thu Aug 9 07:47:20 [interruptThread] removing socket file: /tmp/mongodb-27999.sock
Thu Aug 9 07:47:20 [interruptThread] shutdown: going to flush diaglog...
Thu Aug 9 07:47:20 [interruptThread] shutdown: going to close sockets...
Thu Aug 9 07:47:20 [interruptThread] shutdown: waiting for fs preallocator...
Thu Aug 9 07:47:20 [interruptThread] shutdown: lock for final commit...
Thu Aug 9 07:47:20 [interruptThread] shutdown: final commit...
Thu Aug 9 07:47:20 [interruptThread] shutdown: closing all files...
Thu Aug 9 07:47:20 [interruptThread] closeAllFiles() finished
Thu Aug 9 07:47:20 [interruptThread] journalCleanup...
Thu Aug 9 07:47:20 [interruptThread] removeJournalFiles
Thu Aug 9 07:47:20 [interruptThread] shutdown: removing fs lock...
Thu Aug 9 07:47:20 dbexit: really exiting now
Thu Aug 9 07:47:20 got signal 15 (Terminated), will terminate after current cmd ends