ReplSetTest Starting Set ReplSetTest n is : 0 ReplSetTest n: 0 ports: [ 33801, 33802, 33803 ] 33801 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 33801, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "testReplSet", "dbpath" : "$set-$node", "sslOnNormalPorts" : "", "sslClusterFile" : "jstests/libs/server.pem", "clusterAuthMode" : "x509", "sslPEMKeyFile" : "jstests/libs/server.pem", "sslCRLFile" : "jstests/libs/crl_client_revoked.pem", "sslCAFile" : "jstests/libs/ca.pem", "auth" : "", "restart" : undefined, "pathOpts" : { "node" : 0, "set" : "testReplSet" } } ReplSetTest Starting.... Resetting db path '/data/db/testReplSet-0' 2013-10-03T18:45:38.651+0000 shell: started program mongod --oplogSize 40 --port 33801 --noprealloc --smallfiles --rest --replSet testReplSet --dbpath /data/db/testReplSet-0 --sslOnNormalPorts --sslClusterFile jstests/libs/server.pem --clusterAuthMode x509 --sslPEMKeyFile jstests/libs/server.pem --sslCRLFile jstests/libs/crl_client_revoked.pem --sslCAFile jstests/libs/ca.pem --auth --setParameter enableTestCommands=1 m33801| 2013-10-03T18:45:38.676+0000 ** WARNING: --rest is specified without --httpinterface, m33801| 2013-10-03T18:45:38.676+0000 ** enabling http interface m33801| note: noprealloc may hurt performance in many applications m33801| 2013-10-03T18:45:38.678+0000 ssl imported 1 revoked certificate from the revocation list. m33801| 2013-10-03T18:45:38.679+0000 ssl imported 1 revoked certificate from the revocation list. m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] MongoDB starting : pid=2294 port=33801 dbpath=/data/db/testReplSet-0 64-bit host=llmac m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] ** NOTE: This is a development version (2.5.3-pre-) of MongoDB. m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] ** Not recommended for production. m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] db version v2.5.3-pre- m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] git version: 7e57c5311b0b660cf2df6d3c2cd01245adbafe21 m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] OpenSSL version: OpenSSL 0.9.8y 5 Feb 2013 m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] build info: Darwin llmac 12.5.0 Darwin Kernel Version 12.5.0: Mon Jul 29 16:33:49 PDT 2013; root:xnu-2050.48.11~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] allocator: tcmalloc m33801| 2013-10-03T18:45:38.682+0000 [initandlisten] options: { auth: true, clusterAuthMode: "x509", dbpath: "/data/db/testReplSet-0", noprealloc: true, oplogSize: 40, port: 33801, replSet: "testReplSet", rest: true, setParameter: [ "enableTestCommands=1" ], smallfiles: true, ssl: { CAFile: "jstests/libs/ca.pem", CRLFile: "jstests/libs/crl_client_revoked.pem", PEMKeyFile: "jstests/libs/server.pem", clusterFile: "jstests/libs/server.pem", sslOnNormalPorts: true } } m33801| 2013-10-03T18:45:38.683+0000 [initandlisten] journal dir=/data/db/testReplSet-0/journal m33801| 2013-10-03T18:45:38.683+0000 [initandlisten] recover : no journal files present, no recovery needed m33801| 2013-10-03T18:45:38.695+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-0/local.0, filling with zeroes... m33801| 2013-10-03T18:45:38.695+0000 [FileAllocator] creating directory /data/db/testReplSet-0/_tmp m33801| 2013-10-03T18:45:38.709+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-0/local.0, size: 16MB, took 0.013 secs m33801| 2013-10-03T18:45:38.725+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-0/local.ns, filling with zeroes... m33801| 2013-10-03T18:45:38.739+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-0/local.ns, size: 16MB, took 0.013 secs m33801| 2013-10-03T18:45:38.758+0000 [initandlisten] waiting for connections on port 33801 ssl m33801| 2013-10-03T18:45:38.758+0000 [websvr] admin web console waiting for connections on port 34801 ssl m33801| 2013-10-03T18:45:38.759+0000 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m33801| 2013-10-03T18:45:38.759+0000 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done m33801| 2013-10-03T18:45:38.854+0000 [initandlisten] connection accepted from 127.0.0.1:52788 #1 (1 connection now open) [ connection to llmac:33801 ] ReplSetTest n is : 1 ReplSetTest n: 1 ports: [ 33801, 33802, 33803 ] 33802 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 33802, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "testReplSet", "dbpath" : "$set-$node", "sslOnNormalPorts" : "", "sslClusterFile" : "jstests/libs/server.pem", "clusterAuthMode" : "x509", "sslPEMKeyFile" : "jstests/libs/server.pem", "sslCRLFile" : "jstests/libs/crl_client_revoked.pem", "sslCAFile" : "jstests/libs/ca.pem", "auth" : "", "restart" : undefined, "pathOpts" : { "node" : 1, "set" : "testReplSet" } } ReplSetTest Starting.... Resetting db path '/data/db/testReplSet-1' 2013-10-03T18:45:38.868+0000 shell: started program mongod --oplogSize 40 --port 33802 --noprealloc --smallfiles --rest --replSet testReplSet --dbpath /data/db/testReplSet-1 --sslOnNormalPorts --sslClusterFile jstests/libs/server.pem --clusterAuthMode x509 --sslPEMKeyFile jstests/libs/server.pem --sslCRLFile jstests/libs/crl_client_revoked.pem --sslCAFile jstests/libs/ca.pem --auth --setParameter enableTestCommands=1 m33802| 2013-10-03T18:45:38.894+0000 ** WARNING: --rest is specified without --httpinterface, m33802| 2013-10-03T18:45:38.894+0000 ** enabling http interface m33802| note: noprealloc may hurt performance in many applications m33802| 2013-10-03T18:45:38.896+0000 ssl imported 1 revoked certificate from the revocation list. m33802| 2013-10-03T18:45:38.897+0000 ssl imported 1 revoked certificate from the revocation list. m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] MongoDB starting : pid=2295 port=33802 dbpath=/data/db/testReplSet-1 64-bit host=llmac m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] ** NOTE: This is a development version (2.5.3-pre-) of MongoDB. m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] ** Not recommended for production. m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] db version v2.5.3-pre- m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] git version: 7e57c5311b0b660cf2df6d3c2cd01245adbafe21 m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] OpenSSL version: OpenSSL 0.9.8y 5 Feb 2013 m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] build info: Darwin llmac 12.5.0 Darwin Kernel Version 12.5.0: Mon Jul 29 16:33:49 PDT 2013; root:xnu-2050.48.11~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] allocator: tcmalloc m33802| 2013-10-03T18:45:38.901+0000 [initandlisten] options: { auth: true, clusterAuthMode: "x509", dbpath: "/data/db/testReplSet-1", noprealloc: true, oplogSize: 40, port: 33802, replSet: "testReplSet", rest: true, setParameter: [ "enableTestCommands=1" ], smallfiles: true, ssl: { CAFile: "jstests/libs/ca.pem", CRLFile: "jstests/libs/crl_client_revoked.pem", PEMKeyFile: "jstests/libs/server.pem", clusterFile: "jstests/libs/server.pem", sslOnNormalPorts: true } } m33802| 2013-10-03T18:45:38.902+0000 [initandlisten] journal dir=/data/db/testReplSet-1/journal m33802| 2013-10-03T18:45:38.902+0000 [initandlisten] recover : no journal files present, no recovery needed m33802| 2013-10-03T18:45:38.915+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-1/local.0, filling with zeroes... m33802| 2013-10-03T18:45:38.915+0000 [FileAllocator] creating directory /data/db/testReplSet-1/_tmp m33802| 2013-10-03T18:45:38.929+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-1/local.0, size: 16MB, took 0.013 secs m33802| 2013-10-03T18:45:38.944+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-1/local.ns, filling with zeroes... m33802| 2013-10-03T18:45:38.957+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-1/local.ns, size: 16MB, took 0.013 secs m33802| 2013-10-03T18:45:38.973+0000 [websvr] admin web console waiting for connections on port 34802 ssl m33802| 2013-10-03T18:45:38.973+0000 [initandlisten] waiting for connections on port 33802 ssl m33802| 2013-10-03T18:45:38.974+0000 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m33802| 2013-10-03T18:45:38.974+0000 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done m33802| 2013-10-03T18:45:39.070+0000 [initandlisten] connection accepted from 127.0.0.1:52790 #1 (1 connection now open) [ connection to llmac:33801, connection to llmac:33802 ] ReplSetTest n is : 2 ReplSetTest n: 2 ports: [ 33801, 33802, 33803 ] 33803 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 33803, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "testReplSet", "dbpath" : "$set-$node", "sslOnNormalPorts" : "", "sslClusterFile" : "jstests/libs/server.pem", "clusterAuthMode" : "x509", "sslPEMKeyFile" : "jstests/libs/server.pem", "sslCRLFile" : "jstests/libs/crl_client_revoked.pem", "sslCAFile" : "jstests/libs/ca.pem", "auth" : "", "restart" : undefined, "pathOpts" : { "node" : 2, "set" : "testReplSet" } } ReplSetTest Starting.... Resetting db path '/data/db/testReplSet-2' 2013-10-03T18:45:39.081+0000 shell: started program mongod --oplogSize 40 --port 33803 --noprealloc --smallfiles --rest --replSet testReplSet --dbpath /data/db/testReplSet-2 --sslOnNormalPorts --sslClusterFile jstests/libs/server.pem --clusterAuthMode x509 --sslPEMKeyFile jstests/libs/server.pem --sslCRLFile jstests/libs/crl_client_revoked.pem --sslCAFile jstests/libs/ca.pem --auth --setParameter enableTestCommands=1 m33803| 2013-10-03T18:45:39.105+0000 ** WARNING: --rest is specified without --httpinterface, m33803| 2013-10-03T18:45:39.106+0000 ** enabling http interface m33803| note: noprealloc may hurt performance in many applications m33803| 2013-10-03T18:45:39.107+0000 ssl imported 1 revoked certificate from the revocation list. m33803| 2013-10-03T18:45:39.107+0000 ssl imported 1 revoked certificate from the revocation list. m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] MongoDB starting : pid=2297 port=33803 dbpath=/data/db/testReplSet-2 64-bit host=llmac m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] ** NOTE: This is a development version (2.5.3-pre-) of MongoDB. m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] ** Not recommended for production. m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] db version v2.5.3-pre- m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] git version: 7e57c5311b0b660cf2df6d3c2cd01245adbafe21 m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] OpenSSL version: OpenSSL 0.9.8y 5 Feb 2013 m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] build info: Darwin llmac 12.5.0 Darwin Kernel Version 12.5.0: Mon Jul 29 16:33:49 PDT 2013; root:xnu-2050.48.11~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] allocator: tcmalloc m33803| 2013-10-03T18:45:39.110+0000 [initandlisten] options: { auth: true, clusterAuthMode: "x509", dbpath: "/data/db/testReplSet-2", noprealloc: true, oplogSize: 40, port: 33803, replSet: "testReplSet", rest: true, setParameter: [ "enableTestCommands=1" ], smallfiles: true, ssl: { CAFile: "jstests/libs/ca.pem", CRLFile: "jstests/libs/crl_client_revoked.pem", PEMKeyFile: "jstests/libs/server.pem", clusterFile: "jstests/libs/server.pem", sslOnNormalPorts: true } } m33803| 2013-10-03T18:45:39.111+0000 [initandlisten] journal dir=/data/db/testReplSet-2/journal m33803| 2013-10-03T18:45:39.111+0000 [initandlisten] recover : no journal files present, no recovery needed m33803| 2013-10-03T18:45:39.121+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-2/local.0, filling with zeroes... m33803| 2013-10-03T18:45:39.121+0000 [FileAllocator] creating directory /data/db/testReplSet-2/_tmp m33803| 2013-10-03T18:45:39.134+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-2/local.0, size: 16MB, took 0.012 secs m33803| 2013-10-03T18:45:39.148+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-2/local.ns, filling with zeroes... m33803| 2013-10-03T18:45:39.162+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-2/local.ns, size: 16MB, took 0.013 secs m33803| 2013-10-03T18:45:39.180+0000 [initandlisten] waiting for connections on port 33803 ssl m33803| 2013-10-03T18:45:39.180+0000 [websvr] admin web console waiting for connections on port 34803 ssl m33803| 2013-10-03T18:45:39.181+0000 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m33803| 2013-10-03T18:45:39.181+0000 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done m33803| 2013-10-03T18:45:39.283+0000 [initandlisten] connection accepted from 127.0.0.1:52792 #1 (1 connection now open) [ connection to llmac:33801, connection to llmac:33802, connection to llmac:33803 ] { "replSetInitiate" : { "_id" : "testReplSet", "members" : [ { "_id" : 0, "host" : "llmac:33801" }, { "_id" : 1, "host" : "llmac:33802" }, { "_id" : 2, "host" : "llmac:33803" } ] } } m33801| 2013-10-03T18:45:39.286+0000 [conn1] note: no users configured in admin.system.users, allowing localhost access m33801| 2013-10-03T18:45:39.286+0000 [conn1] replSet replSetInitiate admin command received from client m33801| 2013-10-03T18:45:39.287+0000 [conn1] replSet replSetInitiate config object parses ok, 3 members specified m33802| 2013-10-03T18:45:39.288+0000 [initandlisten] connection accepted from 127.0.0.1:52793 #2 (2 connections now open) m33802| 2013-10-03T18:45:39.295+0000 [conn2] note: no users configured in admin.system.users, allowing localhost access m33802| 2013-10-03T18:45:39.295+0000 [conn2] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:39.296+0000 [initandlisten] connection accepted from 127.0.0.1:52794 #2 (2 connections now open) m33803| 2013-10-03T18:45:39.301+0000 [conn2] note: no users configured in admin.system.users, allowing localhost access m33803| 2013-10-03T18:45:39.302+0000 [conn2] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33801| 2013-10-03T18:45:39.302+0000 [conn1] replSet replSetInitiate all members seem up m33801| 2013-10-03T18:45:39.302+0000 [conn1] ****** m33801| 2013-10-03T18:45:39.302+0000 [conn1] creating replication oplog of size: 40MB... m33801| 2013-10-03T18:45:39.302+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-0/local.1, filling with zeroes... m33801| 2013-10-03T18:45:39.388+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-0/local.1, size: 64MB, took 0.085 secs m33801| 2013-10-03T18:45:39.417+0000 [conn1] ****** m33801| 2013-10-03T18:45:39.417+0000 [conn1] replSet info saving a newer config version to local.system.replset m33801| 2013-10-03T18:45:39.433+0000 [conn1] replSet saveConfigLocally done m33801| 2013-10-03T18:45:39.433+0000 [conn1] replSet replSetInitiate config now saved locally. Should come online in about a minute. m33801| 2013-10-03T18:45:39.433+0000 [conn1] command admin.$cmd command: { replSetInitiate: { _id: "testReplSet", members: [ { _id: 0.0, host: "llmac:33801" }, { _id: 1.0, host: "llmac:33802" }, { _id: 2.0, host: "llmac:33803" } ] } } ntoreturn:1 keyUpdates:0 locks(micros) W:131166 reslen:112 147ms { "info" : "Config now saved locally. Should come online in about a minute.", "ok" : 1 } m33801| 2013-10-03T18:45:39.760+0000 [rsStart] replSet I am llmac:33801 m33801| 2013-10-03T18:45:39.760+0000 [rsStart] replSet STARTUP2 m33801| 2013-10-03T18:45:39.761+0000 [rsSync] replSet SECONDARY m33801| 2013-10-03T18:45:39.761+0000 [rsHealthPoll] replSet member llmac:33802 is up m33801| 2013-10-03T18:45:39.762+0000 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes m33801| 2013-10-03T18:45:39.763+0000 [rsSyncNotifier] build index on: local.me properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.me", "name" : "_id_" } m33801| 2013-10-03T18:45:39.763+0000 [rsSyncNotifier] have free list for local.$freelist m33801| 2013-10-03T18:45:39.764+0000 [rsSyncNotifier] build index done. scanned 0 total records. 0.001 secs m33802| 2013-10-03T18:45:39.975+0000 [rsStart] trying to contact llmac:33801 m33801| 2013-10-03T18:45:39.976+0000 [initandlisten] connection accepted from 127.0.0.1:52795 #2 (2 connections now open) m33801| 2013-10-03T18:45:39.981+0000 [conn2] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:39.983+0000 [rsStart] replSet I am llmac:33802 m33802| 2013-10-03T18:45:39.983+0000 [rsStart] replSet got config version 1 from a remote, saving locally m33802| 2013-10-03T18:45:39.983+0000 [rsStart] replSet info saving a newer config version to local.system.replset m33802| 2013-10-03T18:45:39.987+0000 [rsStart] replSet saveConfigLocally done m33802| 2013-10-03T18:45:39.987+0000 [rsStart] replSet STARTUP2 m33802| 2013-10-03T18:45:39.988+0000 [rsSync] ****** m33802| 2013-10-03T18:45:39.988+0000 [rsSync] creating replication oplog of size: 40MB... m33802| 2013-10-03T18:45:39.988+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-1/local.1, filling with zeroes... m33802| 2013-10-03T18:45:40.074+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-1/local.1, size: 64MB, took 0.086 secs m33802| 2013-10-03T18:45:40.102+0000 [rsSync] ****** m33802| 2013-10-03T18:45:40.102+0000 [rsSync] replSet initial sync pending m33802| 2013-10-03T18:45:40.102+0000 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m33802| 2013-10-03T18:45:40.104+0000 [rsSyncNotifier] build index on: local.me properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.me", "name" : "_id_" } m33802| 2013-10-03T18:45:40.104+0000 [rsSyncNotifier] have free list for local.$freelist m33802| 2013-10-03T18:45:40.105+0000 [rsSyncNotifier] build index done. scanned 0 total records. 0 secs m33803| 2013-10-03T18:45:40.182+0000 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m33803| 2013-10-03T18:45:41.182+0000 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m33801| 2013-10-03T18:45:41.761+0000 [rsHealthPoll] replSet member llmac:33803 is up m33801| 2013-10-03T18:45:41.762+0000 [rsMgr] not electing self, llmac:33802 would veto with 'I don't think llmac:33801 is electable' m33801| 2013-10-03T18:45:41.762+0000 [rsHealthPoll] replset info llmac:33802 thinks that we are down m33801| 2013-10-03T18:45:41.762+0000 [rsHealthPoll] replSet member llmac:33802 is now in state STARTUP2 m33801| 2013-10-03T18:45:41.763+0000 [rsMgr] not electing self, llmac:33802 would veto with 'I don't think llmac:33801 is electable' m33802| 2013-10-03T18:45:41.984+0000 [rsHealthPoll] replSet member llmac:33801 is up m33803| 2013-10-03T18:45:41.984+0000 [initandlisten] connection accepted from 127.0.0.1:52796 #3 (3 connections now open) m33802| 2013-10-03T18:45:41.984+0000 [rsHealthPoll] replSet member llmac:33801 is now in state SECONDARY m33803| 2013-10-03T18:45:41.989+0000 [conn3] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:41.989+0000 [rsHealthPoll] replSet member llmac:33803 is up m33803| 2013-10-03T18:45:42.183+0000 [rsStart] trying to contact llmac:33801 m33801| 2013-10-03T18:45:42.184+0000 [initandlisten] connection accepted from 127.0.0.1:52797 #3 (3 connections now open) m33801| 2013-10-03T18:45:42.192+0000 [conn3] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:42.193+0000 [rsStart] trying to contact llmac:33802 m33802| 2013-10-03T18:45:42.194+0000 [initandlisten] connection accepted from 127.0.0.1:52798 #3 (3 connections now open) m33802| 2013-10-03T18:45:42.199+0000 [conn3] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:42.200+0000 [rsStart] replSet I am llmac:33803 m33803| 2013-10-03T18:45:42.200+0000 [rsStart] replSet got config version 1 from a remote, saving locally m33803| 2013-10-03T18:45:42.200+0000 [rsStart] replSet info saving a newer config version to local.system.replset m33803| 2013-10-03T18:45:42.204+0000 [rsStart] replSet saveConfigLocally done m33803| 2013-10-03T18:45:42.205+0000 [rsStart] replSet STARTUP2 m33803| 2013-10-03T18:45:42.205+0000 [rsSync] ****** m33803| 2013-10-03T18:45:42.205+0000 [rsSync] creating replication oplog of size: 40MB... m33803| 2013-10-03T18:45:42.205+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-2/local.1, filling with zeroes... m33803| 2013-10-03T18:45:42.305+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-2/local.1, size: 64MB, took 0.099 secs m33803| 2013-10-03T18:45:42.333+0000 [rsSync] ****** m33803| 2013-10-03T18:45:42.333+0000 [rsSync] replSet initial sync pending m33803| 2013-10-03T18:45:42.333+0000 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m33803| 2013-10-03T18:45:42.336+0000 [rsSyncNotifier] build index on: local.me properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.me", "name" : "_id_" } m33803| 2013-10-03T18:45:42.337+0000 [rsSyncNotifier] have free list for local.$freelist m33803| 2013-10-03T18:45:42.337+0000 [rsSyncNotifier] build index done. scanned 0 total records. 0.001 secs m33801| 2013-10-03T18:45:43.762+0000 [rsHealthPoll] replset info llmac:33803 thinks that we are down m33801| 2013-10-03T18:45:43.762+0000 [rsHealthPoll] replSet member llmac:33803 is now in state STARTUP2 m33801| 2013-10-03T18:45:43.763+0000 [rsMgr] not electing self, llmac:33803 would veto with 'I don't think llmac:33801 is electable' m33802| 2013-10-03T18:45:43.990+0000 [rsHealthPoll] replset info llmac:33803 thinks that we are down m33802| 2013-10-03T18:45:43.990+0000 [rsHealthPoll] replSet member llmac:33803 is now in state STARTUP2 m33803| 2013-10-03T18:45:44.201+0000 [rsHealthPoll] replSet member llmac:33802 is up m33803| 2013-10-03T18:45:44.201+0000 [rsHealthPoll] replSet member llmac:33801 is up m33803| 2013-10-03T18:45:44.201+0000 [rsHealthPoll] replSet member llmac:33802 is now in state STARTUP2 m33803| 2013-10-03T18:45:44.201+0000 [rsHealthPoll] replSet member llmac:33801 is now in state SECONDARY m33801| 2013-10-03T18:45:49.765+0000 [rsMgr] replSet info electSelf 0 m33803| 2013-10-03T18:45:49.765+0000 [conn2] replSet RECOVERING m33803| 2013-10-03T18:45:49.765+0000 [conn2] replSet info voting yea for llmac:33801 (0) m33802| 2013-10-03T18:45:49.765+0000 [conn2] replSet RECOVERING m33802| 2013-10-03T18:45:49.766+0000 [conn2] replSet info voting yea for llmac:33801 (0) m33801| 2013-10-03T18:45:49.766+0000 [rsMgr] replSet PRIMARY m33802| 2013-10-03T18:45:49.986+0000 [rsHealthPoll] replSet member llmac:33801 is now in state PRIMARY m33802| 2013-10-03T18:45:49.992+0000 [rsHealthPoll] replSet member llmac:33803 is now in state RECOVERING m33803| 2013-10-03T18:45:50.203+0000 [rsHealthPoll] replSet member llmac:33802 is now in state RECOVERING m33803| 2013-10-03T18:45:50.203+0000 [rsHealthPoll] replSet member llmac:33801 is now in state PRIMARY m33801| 2013-10-03T18:45:51.765+0000 [rsHealthPoll] replSet member llmac:33802 is now in state RECOVERING m33801| 2013-10-03T18:45:51.765+0000 [rsHealthPoll] replSet member llmac:33803 is now in state RECOVERING m33802| 2013-10-03T18:45:53.765+0000 [conn2] end connection 127.0.0.1:52793 (2 connections now open) m33802| 2013-10-03T18:45:53.766+0000 [initandlisten] connection accepted from 127.0.0.1:52799 #4 (3 connections now open) m33802| 2013-10-03T18:45:53.772+0000 [conn4] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33801| 2013-10-03T18:45:55.987+0000 [conn2] end connection 127.0.0.1:52795 (2 connections now open) m33801| 2013-10-03T18:45:55.988+0000 [initandlisten] connection accepted from 127.0.0.1:52806 #4 (3 connections now open) m33801| 2013-10-03T18:45:55.994+0000 [conn4] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:56.098+0000 [rsSync] replSet initial sync pending m33802| 2013-10-03T18:45:56.098+0000 [rsSync] replSet syncing to: llmac:33801 m33801| 2013-10-03T18:45:56.099+0000 [initandlisten] connection accepted from 127.0.0.1:52807 #5 (4 connections now open) m33801| 2013-10-03T18:45:56.105+0000 [conn5] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:56.106+0000 [rsSync] build index on: local.replset.minvalid properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.replset.minvalid", "name" : "_id_" } m33802| 2013-10-03T18:45:56.107+0000 [rsSync] build index done. scanned 0 total records. 0 secs m33802| 2013-10-03T18:45:56.107+0000 [rsSync] replSet initial sync drop all databases m33802| 2013-10-03T18:45:56.107+0000 [rsSync] dropAllDatabasesExceptLocal 1 m33802| 2013-10-03T18:45:56.107+0000 [rsSync] replSet initial sync clone all databases m33802| 2013-10-03T18:45:56.108+0000 [rsSync] replSet initial sync cloning db: admin m33801| 2013-10-03T18:45:56.108+0000 [initandlisten] connection accepted from 127.0.0.1:52808 #6 (5 connections now open) m33801| 2013-10-03T18:45:56.114+0000 [conn6] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:56.114+0000 [rsSync] replSet initial sync data copy, starting syncup m33802| 2013-10-03T18:45:56.114+0000 [rsSync] oplog sync 1 of 3 m33802| 2013-10-03T18:45:56.115+0000 [rsSync] oplog sync 2 of 3 m33802| 2013-10-03T18:45:56.115+0000 [rsSync] replSet initial sync building indexes m33802| 2013-10-03T18:45:56.115+0000 [rsSync] replSet initial sync cloning indexes for : admin m33801| 2013-10-03T18:45:56.116+0000 [conn6] end connection 127.0.0.1:52808 (4 connections now open) m33802| 2013-10-03T18:45:56.116+0000 [rsSync] oplog sync 3 of 3 m33802| 2013-10-03T18:45:56.116+0000 [rsSync] replSet initial sync finishing up m33802| 2013-10-03T18:45:56.126+0000 [rsSync] replSet set minValid=524dbb53:1 m33802| 2013-10-03T18:45:56.134+0000 [rsSync] replSet initial sync done m33801| 2013-10-03T18:45:56.134+0000 [conn5] end connection 127.0.0.1:52807 (3 connections now open) m33802| 2013-10-03T18:45:56.996+0000 [rsBackgroundSync] replSet syncing to: llmac:33801 m33801| 2013-10-03T18:45:56.997+0000 [initandlisten] connection accepted from 127.0.0.1:52809 #7 (4 connections now open) m33801| 2013-10-03T18:45:57.001+0000 [conn7] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33801| 2013-10-03T18:45:57.002+0000 [initandlisten] connection accepted from 127.0.0.1:52810 #8 (5 connections now open) m33801| 2013-10-03T18:45:57.006+0000 [conn8] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33802| 2013-10-03T18:45:57.135+0000 [rsSync] replSet SECONDARY m33801| 2013-10-03T18:45:57.773+0000 [rsHealthPoll] replSet member llmac:33802 is now in state SECONDARY m33801| 2013-10-03T18:45:58.118+0000 [slaveTracking] build index on: local.slaves properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.slaves", "name" : "_id_" } m33801| 2013-10-03T18:45:58.119+0000 [slaveTracking] build index done. scanned 0 total records. 0 secs m33801| 2013-10-03T18:45:58.204+0000 [conn3] end connection 127.0.0.1:52797 (4 connections now open) m33803| 2013-10-03T18:45:58.205+0000 [rsHealthPoll] replSet member llmac:33802 is now in state SECONDARY m33801| 2013-10-03T18:45:58.205+0000 [initandlisten] connection accepted from 127.0.0.1:52811 #9 (5 connections now open) m33801| 2013-10-03T18:45:58.209+0000 [conn9] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:58.329+0000 [rsSync] replSet initial sync pending m33803| 2013-10-03T18:45:58.329+0000 [rsSync] replSet syncing to: llmac:33801 m33801| 2013-10-03T18:45:58.329+0000 [initandlisten] connection accepted from 127.0.0.1:52812 #10 (6 connections now open) m33801| 2013-10-03T18:45:58.336+0000 [conn10] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:58.337+0000 [rsSync] build index on: local.replset.minvalid properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "local.replset.minvalid", "name" : "_id_" } m33803| 2013-10-03T18:45:58.337+0000 [rsSync] build index done. scanned 0 total records. 0 secs m33803| 2013-10-03T18:45:58.338+0000 [rsSync] replSet initial sync drop all databases m33803| 2013-10-03T18:45:58.338+0000 [rsSync] dropAllDatabasesExceptLocal 1 m33803| 2013-10-03T18:45:58.338+0000 [rsSync] replSet initial sync clone all databases m33803| 2013-10-03T18:45:58.338+0000 [rsSync] replSet initial sync cloning db: admin m33801| 2013-10-03T18:45:58.339+0000 [initandlisten] connection accepted from 127.0.0.1:52813 #11 (7 connections now open) m33801| 2013-10-03T18:45:58.344+0000 [conn11] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:58.344+0000 [rsSync] replSet initial sync data copy, starting syncup m33803| 2013-10-03T18:45:58.344+0000 [rsSync] oplog sync 1 of 3 m33803| 2013-10-03T18:45:58.345+0000 [rsSync] oplog sync 2 of 3 m33803| 2013-10-03T18:45:58.345+0000 [rsSync] replSet initial sync building indexes m33803| 2013-10-03T18:45:58.345+0000 [rsSync] replSet initial sync cloning indexes for : admin m33801| 2013-10-03T18:45:58.346+0000 [conn11] end connection 127.0.0.1:52813 (6 connections now open) m33803| 2013-10-03T18:45:58.346+0000 [rsSync] oplog sync 3 of 3 m33803| 2013-10-03T18:45:58.346+0000 [rsSync] replSet initial sync finishing up m33803| 2013-10-03T18:45:58.356+0000 [rsSync] replSet set minValid=524dbb53:1 m33803| 2013-10-03T18:45:58.364+0000 [rsSync] replSet initial sync done m33801| 2013-10-03T18:45:58.364+0000 [conn10] end connection 127.0.0.1:52812 (5 connections now open) m33803| 2013-10-03T18:45:59.215+0000 [rsBackgroundSync] replSet syncing to: llmac:33801 m33801| 2013-10-03T18:45:59.216+0000 [initandlisten] connection accepted from 127.0.0.1:52814 #12 (6 connections now open) m33801| 2013-10-03T18:45:59.220+0000 [conn12] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33801| 2013-10-03T18:45:59.221+0000 [initandlisten] connection accepted from 127.0.0.1:52815 #13 (7 connections now open) m33801| 2013-10-03T18:45:59.225+0000 [conn13] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } m33803| 2013-10-03T18:45:59.365+0000 [rsSync] replSet SECONDARY ReplSetTest awaitReplication: starting: timestamp for primary, llmac:33801, is Timestamp(1380825939, 1) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1380825939, 1) ReplSetTest awaitReplication: checking secondary #1: llmac:33802 ReplSetTest awaitReplication: secondary #1, llmac:33802, is synced ReplSetTest awaitReplication: checking secondary #2: llmac:33803 ReplSetTest awaitReplication: secondary #2, llmac:33803, is synced ReplSetTest awaitReplication: finished: all 2 secondaries synced at timestamp Timestamp(1380825939, 1) 2013-10-03T18:45:59.415+0000 shell: started program mongo --port 33801 --ssl --sslPEMKeyFile jstests/libs/server.pem --eval db.getSiblingDB("$external").addUser({ user:"emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US", roles: [ {name: 'clusterAdmin', source: 'admin', hasRole: true, 'canDelegate': true}, {name: 'userAdminAnyDatabase', source: 'admin', hasRole: true, 'canDelegate': true}, {name: 'readWriteAnyDatabase', source: 'admin', hasRole: true, 'canDelegate': true}, {name: 'dbAdminAnyDatabase', source: 'admin', hasRole: true, 'canDelegate': true}]});var authSuccess = db.getSiblingDB("$external").auth({ user:"emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US", mechanism:"MONGODB-X509"});quit(authSuccess == 1 ? 0 : 1) sh2298| MongoDB shell version: 2.5.3-pre- sh2298| connecting to: 127.0.0.1:33801/test m33801| 2013-10-03T18:45:59.457+0000 [initandlisten] connection accepted from 127.0.0.1:52816 #14 (8 connections now open) m33801| 2013-10-03T18:45:59.492+0000 [conn14] Attempting to lock user data for: Create user m33801| 2013-10-03T18:45:59.492+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-0/admin.0, filling with zeroes... m33801| 2013-10-03T18:45:59.506+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-0/admin.0, size: 16MB, took 0.013 secs m33801| 2013-10-03T18:45:59.520+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-0/admin.ns, filling with zeroes... m33801| 2013-10-03T18:45:59.534+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-0/admin.ns, size: 16MB, took 0.013 secs m33801| 2013-10-03T18:45:59.550+0000 [conn14] build index on: admin.system.users properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "admin.system.users", "name" : "_id_" } m33801| 2013-10-03T18:45:59.550+0000 [conn14] have free list for admin.$freelist m33801| 2013-10-03T18:45:59.551+0000 [conn14] build index done. scanned 0 total records. 0 secs m33801| 2013-10-03T18:45:59.551+0000 [conn14] build index on: admin.system.users properties: { "v" : 1, "key" : { "name" : 1, "source" : 1 }, "unique" : true, "ns" : "admin.system.users", "name" : "name_1_source_1" } m33801| 2013-10-03T18:45:59.551+0000 [conn14] build index done. scanned 0 total records. 0 secs m33803| 2013-10-03T18:45:59.552+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-2/admin.0, filling with zeroes... m33802| 2013-10-03T18:45:59.552+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-1/admin.0, filling with zeroes... m33803| 2013-10-03T18:45:59.565+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-2/admin.0, size: 16MB, took 0.013 secs m33802| 2013-10-03T18:45:59.579+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-1/admin.0, size: 16MB, took 0.027 secs m33803| 2013-10-03T18:45:59.593+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-2/admin.ns, filling with zeroes... m33802| 2013-10-03T18:45:59.600+0000 [FileAllocator] allocating new datafile /data/db/testReplSet-1/admin.ns, filling with zeroes... m33803| 2013-10-03T18:45:59.606+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-2/admin.ns, size: 16MB, took 0.013 secs m33802| 2013-10-03T18:45:59.626+0000 [FileAllocator] done allocating datafile /data/db/testReplSet-1/admin.ns, size: 16MB, took 0.025 secs m33803| 2013-10-03T18:45:59.635+0000 [repl writer worker 1] build index on: admin.system.users properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "admin.system.users", "name" : "_id_" } m33803| 2013-10-03T18:45:59.636+0000 [repl writer worker 1] have free list for admin.$freelist m33803| 2013-10-03T18:45:59.636+0000 [repl writer worker 1] build index done. scanned 0 total records. 0.001 secs m33803| 2013-10-03T18:45:59.636+0000 [repl writer worker 1] build index on: admin.system.users properties: { "v" : 1, "key" : { "name" : 1, "source" : 1 }, "unique" : true, "ns" : "admin.system.users", "name" : "name_1_source_1" } m33803| 2013-10-03T18:45:59.637+0000 [repl writer worker 1] build index done. scanned 0 total records. 0 secs m33801| 2013-10-03T18:45:59.638+0000 [conn14] command $external.$cmd command: { createUser: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US", roles: [ { name: "clusterAdmin", source: "admin", hasRole: true, canDelegate: true }, { name: "userAdminAnyDatabase", source: "admin", hasRole: true, canDelegate: true }, { name: "readWriteAnyDatabase", source: "admin", hasRole: true, canDelegate: true }, { name: "dbAdminAnyDatabase", source: "admin", hasRole: true, canDelegate: true } ], writeConcern: { w: "majority", wtimeout: 30000.0 } } ntoreturn:1 keyUpdates:0 locks(micros) W:59261 r:10 reslen:37 145ms sh2298| { sh2298| "user" : "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US", sh2298| "roles" : [ sh2298| { sh2298| "name" : "clusterAdmin", sh2298| "source" : "admin", sh2298| "hasRole" : true, sh2298| "canDelegate" : true sh2298| }, sh2298| { sh2298| "name" : "userAdminAnyDatabase", sh2298| "source" : "admin", sh2298| "hasRole" : true, sh2298| "canDelegate" : true sh2298| }, sh2298| { sh2298| "name" : "readWriteAnyDatabase", sh2298| "source" : "admin", sh2298| "hasRole" : true, sh2298| "canDelegate" : true sh2298| }, sh2298| { sh2298| "name" : "dbAdminAnyDatabase", sh2298| "source" : "admin", sh2298| "hasRole" : true, sh2298| "canDelegate" : true sh2298| } sh2298| ] sh2298| } m33801| 2013-10-03T18:45:59.640+0000 [conn14] authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "emailAddress=root@lazarus,CN=server,OU=Kernel,O=10Gen,L=New York City,ST=New York,C=US" } assert: [0] != [0] are equal : should NOT be able to authenticate with an invalid certificate m33801| 2013-10-03T18:45:59.642+0000 [conn14] end connection 127.0.0.1:52816 (7 connections now open) m33802| 2013-10-03T18:45:59.643+0000 [repl writer worker 1] build index on: admin.system.users properties: { "v" : 1, "key" : { "_id" : 1 }, "ns" : "admin.system.users", "name" : "_id_" } m33802| 2013-10-03T18:45:59.644+0000 [repl writer worker 1] have free list for admin.$freelist m33802| 2013-10-03T18:45:59.644+0000 [repl writer worker 1] build index done. scanned 0 total records. 0.001 secs m33802| 2013-10-03T18:45:59.644+0000 [repl writer worker 1] build index on: admin.system.users properties: { "v" : 1, "key" : { "name" : 1, "source" : 1 }, "unique" : true, "ns" : "admin.system.users", "name" : "name_1_source_1" } m33802| 2013-10-03T18:45:59.644+0000 [repl writer worker 1] build index done. scanned 0 total records. 0 secs Error: Printing Stack Trace at printStackTrace (src/mongo/shell/utils.js:37:15) at doassert (src/mongo/shell/assert.js:6:5) at Function.assert.neq (src/mongo/shell/assert.js:108:5) at doTest (invalidCert.js:15:12) at testReplicaSet (338_helpers.js:111:5) at invalidCert.js:18:1 2013-10-03T18:45:59.645+0000 [0] != [0] are equal : should NOT be able to authenticate with an invalid certificate at src/mongo/shell/assert.js:7 failed to load: invalidCert.js m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] now exiting m33801| dbexit: 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: going to close listening sockets... m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] closing listening socket: 12 m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] closing listening socket: 13 m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] closing listening socket: 15 m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] removing socket file: /tmp/mongodb-33801.sock m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: going to flush diaglog... m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: going to close sockets... m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: waiting for fs preallocator... m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: lock for final commit... m33801| 2013-10-03T18:45:59.645+0000 [signalProcessingThread] shutdown: final commit... m33801| 2013-10-03T18:45:59.646+0000 [conn1] end connection 127.0.0.1:52788 (6 connections now open) m33801| 2013-10-03T18:45:59.646+0000 ERROR: could not negotiate SSL connection: EOF detected m33801| 2013-10-03T18:45:59.646+0000 [conn4] end connection 127.0.0.1:52806 (6 connections now open) m33801| 2013-10-03T18:45:59.646+0000 [conn13] end connection 127.0.0.1:52815 (6 connections now open) m33803| 2013-10-03T18:45:59.646+0000 [rsBackgroundSync] caught exception (socket exception [CLOSED] for 127.0.0.1:33801) in destructor (~PiggyBackData) m33803| 2013-10-03T18:45:59.646+0000 [rsBackgroundSync] replSet sync source problem: 10278 dbclient error communicating with server: llmac:33801 m33803| 2013-10-03T18:45:59.646+0000 [rsBackgroundSync] replSet syncing to: llmac:33801 m33803| 2013-10-03T18:45:59.647+0000 [conn2] end connection 127.0.0.1:52794 (2 connections now open) m33802| 2013-10-03T18:45:59.646+0000 [SyncSourceFeedbackThread] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "11600 interrupted at shutdown", code: 11600 } m33802| 2013-10-03T18:45:59.646+0000 [rsBackgroundSync] caught exception (socket exception [CLOSED] for 127.0.0.1:33801) in destructor (~PiggyBackData) m33802| 2013-10-03T18:45:59.647+0000 [rsBackgroundSync] replSet sync source problem: 10278 dbclient error communicating with server: llmac:33801 m33802| 2013-10-03T18:45:59.647+0000 [rsBackgroundSync] replSet syncing to: llmac:33801 m33801| 2013-10-03T18:45:59.647+0000 [conn9] end connection 127.0.0.1:52811 (6 connections now open) m33802| 2013-10-03T18:45:59.647+0000 [conn4] end connection 127.0.0.1:52799 (2 connections now open) m33803| 2013-10-03T18:45:59.648+0000 [rsBackgroundSync] repl: couldn't connect to server llmac:33801 m33802| 2013-10-03T18:45:59.648+0000 [SyncSourceFeedbackThread] repl: couldn't connect to server llmac:33801 m33802| 2013-10-03T18:45:59.648+0000 [rsBackgroundSync] repl: couldn't connect to server llmac:33801 m33801| 2013-10-03T18:45:59.664+0000 [signalProcessingThread] shutdown: closing all files... m33801| 2013-10-03T18:45:59.666+0000 [signalProcessingThread] closeAllFiles() finished m33801| 2013-10-03T18:45:59.666+0000 [signalProcessingThread] journalCleanup... m33801| 2013-10-03T18:45:59.666+0000 [signalProcessingThread] removeJournalFiles m33801| 2013-10-03T18:45:59.666+0000 [signalProcessingThread] shutdown: removing fs lock... m33802| 2013-10-03T18:45:59.996+0000 [rsHealthPoll] DBClientCursor::init call() failed m33802| 2013-10-03T18:45:59.996+0000 [rsHealthPoll] replset info llmac:33801 heartbeat failed, retrying m33802| 2013-10-03T18:45:59.996+0000 [rsHealthPoll] replSet member llmac:33803 is now in state SECONDARY m33802| 2013-10-03T18:45:59.998+0000 [rsHealthPoll] replSet info llmac:33801 is down (or slow to respond): m33802| 2013-10-03T18:45:59.998+0000 [rsHealthPoll] replSet member llmac:33801 is now in state DOWN m33802| 2013-10-03T18:45:59.999+0000 [rsMgr] not electing self, llmac:33803 would veto with 'llmac:33802 is trying to elect itself but llmac:33801 is already primary and more up-to-date' m33802| 2013-10-03T18:46:00.150+0000 [SyncSourceFeedbackThread] repl: couldn't connect to server llmac:33801 m33803| 2013-10-03T18:46:00.209+0000 [rsHealthPoll] DBClientCursor::init call() failed m33803| 2013-10-03T18:46:00.209+0000 [rsHealthPoll] replset info llmac:33801 heartbeat failed, retrying m33803| 2013-10-03T18:46:00.212+0000 [rsHealthPoll] replSet info llmac:33801 is down (or slow to respond): m33803| 2013-10-03T18:46:00.212+0000 [rsHealthPoll] replSet member llmac:33801 is now in state DOWN m33803| 2013-10-03T18:46:00.212+0000 [rsMgr] not electing self, llmac:33802 would veto with 'I don't think llmac:33803 is electable' m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] now exiting m33802| dbexit: 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: going to close listening sockets... m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] closing listening socket: 14 m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] closing listening socket: 16 m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] closing listening socket: 18 m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] removing socket file: /tmp/mongodb-33802.sock m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: going to flush diaglog... m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: going to close sockets... m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: waiting for fs preallocator... m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: lock for final commit... m33802| 2013-10-03T18:46:00.646+0000 [signalProcessingThread] shutdown: final commit... m33802| 2013-10-03T18:46:00.647+0000 [conn1] end connection 127.0.0.1:52790 (1 connection now open) m33802| 2013-10-03T18:46:00.647+0000 [conn3] end connection 127.0.0.1:52798 (1 connection now open) m33803| 2013-10-03T18:46:00.647+0000 [conn3] end connection 127.0.0.1:52796 (1 connection now open) m33802| 2013-10-03T18:46:00.665+0000 [signalProcessingThread] shutdown: closing all files... m33802| 2013-10-03T18:46:00.671+0000 [signalProcessingThread] closeAllFiles() finished m33802| 2013-10-03T18:46:00.671+0000 [signalProcessingThread] journalCleanup... m33802| 2013-10-03T18:46:00.671+0000 [signalProcessingThread] removeJournalFiles m33802| 2013-10-03T18:46:00.672+0000 [signalProcessingThread] shutdown: removing fs lock... m33803| 2013-10-03T18:46:01.646+0000 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m33803| 2013-10-03T18:46:01.646+0000 [signalProcessingThread] now exiting m33803| dbexit: 2013-10-03T18:46:01.646+0000 [signalProcessingThread] shutdown: going to close listening sockets... m33803| 2013-10-03T18:46:01.646+0000 [signalProcessingThread] closing listening socket: 17 m33803| 2013-10-03T18:46:01.646+0000 [signalProcessingThread] closing listening socket: 19 m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] closing listening socket: 21 m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] removing socket file: /tmp/mongodb-33803.sock m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] shutdown: going to flush diaglog... m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] shutdown: going to close sockets... m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] shutdown: waiting for fs preallocator... m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] shutdown: lock for final commit... m33803| 2013-10-03T18:46:01.647+0000 [signalProcessingThread] shutdown: final commit... m33803| 2013-10-03T18:46:01.647+0000 [conn1] end connection 127.0.0.1:52792 (0 connections now open) m33803| 2013-10-03T18:46:01.663+0000 [signalProcessingThread] shutdown: closing all files... m33803| 2013-10-03T18:46:01.664+0000 [signalProcessingThread] closeAllFiles() finished m33803| 2013-10-03T18:46:01.664+0000 [signalProcessingThread] journalCleanup... m33803| 2013-10-03T18:46:01.664+0000 [signalProcessingThread] removeJournalFiles m33803| 2013-10-03T18:46:01.664+0000 [signalProcessingThread] shutdown: removing fs lock...