2014-11-12T17:14:50.973-0500 I CONTROL [initandlisten] MongoDB starting : pid=10673 port=27999 dbpath=/data/db/sconsTests/ 64-bit host=charlie-macbook-pro 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] ** NOTE: This is a development version (2.7.9-pre-) of MongoDB. 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] ** Not recommended for production. 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] db version v2.7.9-pre- 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] git version: 04869a65202864514e6066ef77798a39c7c4920d 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] build info: Darwin charlie-macbook-pro 14.0.0 Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] allocator: tcmalloc 2014-11-12T17:14:50.974-0500 I CONTROL [initandlisten] options: { net: { http: { enabled: true }, port: 27999 }, setParameter: { enableTestCommands: "1" }, storage: { dbPath: "/data/db/sconsTests/" } } 2014-11-12T17:14:50.975-0500 I JOURNAL [initandlisten] journal dir=/data/db/sconsTests/journal 2014-11-12T17:14:50.975-0500 I JOURNAL [initandlisten] recover : no journal files present, no recovery needed 2014-11-12T17:14:50.988-0500 I NETWORK [websvr] admin web console waiting for connections on port 28999 2014-11-12T17:14:51.001-0500 I INDEXING [initandlisten] allocating new ns file /data/db/sconsTests/local.ns, filling with zeroes... 2014-11-12T17:14:51.030-0500 I STORAGE [FileAllocator] allocating new datafile /data/db/sconsTests/local.0, filling with zeroes... 2014-11-12T17:14:51.030-0500 I STORAGE [FileAllocator] creating directory /data/db/sconsTests/_tmp 2014-11-12T17:14:51.115-0500 I STORAGE [FileAllocator] done allocating datafile /data/db/sconsTests/local.0, size: 64MB, took 0.084 secs 2014-11-12T17:14:51.131-0500 I QUERY [initandlisten] command local.$cmd command: create { create: "startup_log", size: 10485760, capped: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:37 142ms 2014-11-12T17:14:51.131-0500 I NETWORK [initandlisten] waiting for connections on port 27999 2014-11-12T17:14:51.961-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60158 #1 (1 connection now open) 2014-11-12T17:14:51.961-0500 I NETWORK [conn1] end connection 127.0.0.1:60158 (0 connections now open) 2014-11-12T17:14:51.961-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60159 #2 (1 connection now open) clean_dbroot: /data/db/sconsTests/ num procs:252 running /Users/charlie/github/mongo/mongod --port 27999 --dbpath /data/db/sconsTests/ --setParameter enableTestCommands=1 --httpinterface ******************************************* Test : config_validation.js ... 2014-11-12T17:14:51.962-0500 I NETWORK [conn2] end connection 127.0.0.1:60159 (0 connections now open) Command : /Users/charlie/github/mongo/mongo --port 27999 --authenticationMechanism SCRAM-SHA-1 --writeMode legacy /Users/charlie/github/mongo/jstests/multiVersion/config_validation.js --eval TestData = new Object();TestData.storageEngine = "";TestData.testPath = "/Users/charlie/github/mongo/jstests/multiVersion/config_validation.js";TestData.testFile = "config_validation.js";TestData.testName = "config_validation";TestData.setParameters = "";TestData.setParametersMongos = "";TestData.noJournal = false;TestData.noJournalPrealloc = false;TestData.auth = false;TestData.keyFile = null;TestData.keyFileData = null;TestData.authMechanism = "SCRAM-SHA-1";TestData.useSSL = false;TestData.useX509 = false;MongoRunner.dataDir = "/data/db";MongoRunner.dataPath = MongoRunner.dataDir + "/"; Date : Wed Nov 12 17:14:51 2014 MongoDB shell version: 2.7.9-pre- connecting to: 127.0.0.1:27999/test 2014-11-12T17:14:52.006-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60163 #3 (1 connection now open) /data/db/ ReplSetTest Starting Set ReplSetTest n is : 0 ReplSetTest n: 0 ports: [ 31000, 31001, 31002 ] 31000 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31000, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "config_validation", "dbpath" : "$set-$node", "binVersion" : "2.6", "restart" : undefined, "pathOpts" : { "node" : 0, "set" : "config_validation" } } ReplSetTest Starting.... Resetting db path '/data/db/config_validation-0' 2014-11-12T17:14:52.015-0500 I - shell: started program /Users/charlie/github/mongo/mongod-2.6 --oplogSize 40 --port 31000 --noprealloc --smallfiles --rest --replSet config_validation --dbpath /data/db/config_validation-0 2014-11-12T17:14:52.016-0500 W NETWORK Failed to connect to 127.0.0.1:31000, reason: errno:61 Connection refused m31000| 2014-11-12T17:14:52.047-0500 ** WARNING: --rest is specified without --httpinterface, m31000| 2014-11-12T17:14:52.047-0500 ** enabling http interface m31000| note: noprealloc may hurt performance in many applications m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] MongoDB starting : pid=10675 port=31000 dbpath=/data/db/config_validation-0 64-bit host=charlie-macbook-pro m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] db version v2.6.4 m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] git version: nogitversion m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] build info: Darwin charlie-macbook-pro 13.4.0 Darwin Kernel Version 13.4.0: Sun Aug 17 19:50:11 PDT 2014; root:xnu-2422.115.4~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] allocator: tcmalloc m31000| 2014-11-12T17:14:52.056-0500 [initandlisten] options: { net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 31000 }, replication: { oplogSizeMB: 40, replSet: "config_validation" }, storage: { dbPath: "/data/db/config_validation-0", preallocDataFiles: false, smallFiles: true } } m31000| 2014-11-12T17:14:52.058-0500 [initandlisten] journal dir=/data/db/config_validation-0/journal m31000| 2014-11-12T17:14:52.058-0500 [initandlisten] recover : no journal files present, no recovery needed m31000| 2014-11-12T17:14:52.074-0500 [FileAllocator] allocating new datafile /data/db/config_validation-0/local.ns, filling with zeroes... m31000| 2014-11-12T17:14:52.074-0500 [FileAllocator] creating directory /data/db/config_validation-0/_tmp m31000| 2014-11-12T17:14:52.113-0500 [FileAllocator] done allocating datafile /data/db/config_validation-0/local.ns, size: 16MB, took 0.038 secs m31000| 2014-11-12T17:14:52.182-0500 [FileAllocator] allocating new datafile /data/db/config_validation-0/local.0, filling with zeroes... m31000| 2014-11-12T17:14:52.194-0500 [FileAllocator] done allocating datafile /data/db/config_validation-0/local.0, size: 16MB, took 0.011 secs m31000| 2014-11-12T17:14:52.216-0500 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } m31000| 2014-11-12T17:14:52.216-0500 [initandlisten] added index to empty collection m31000| 2014-11-12T17:14:52.217-0500 [initandlisten] command local.$cmd command: create { create: "startup_log", size: 10485760, capped: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:37 142ms [ connection to charlie-macbook-pro:31000 ] ReplSetTest n is : 1 ReplSetTest n: 1 ports: [ 31000, 31001, 31002 ] 31001 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31001, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "config_validation", "dbpath" : "$set-$node", "binVersion" : "2.6", "restart" : undefined, "pathOpts" : { "node" : 1, "set" : "config_validation" } } ReplSetTest Starting.... Resetting db path '/data/db/config_validation-1' m31000| 2014-11-12T17:14:52.220-0500 [websvr] admin web console waiting for connections on port 32000 m31000| 2014-11-12T17:14:52.221-0500 [initandlisten] waiting for connections on port 31000 m31000| 2014-11-12T17:14:52.221-0500 [initandlisten] connection accepted from 127.0.0.1:60167 #1 (1 connection now open) 2014-11-12T17:14:52.225-0500 I - shell: started program /Users/charlie/github/mongo/mongod-2.6 --oplogSize 40 --port 31001 --noprealloc --smallfiles --rest --replSet config_validation --dbpath /data/db/config_validation-1 m31000| 2014-11-12T17:14:52.225-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31000| 2014-11-12T17:14:52.225-0500 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done 2014-11-12T17:14:52.226-0500 W NETWORK Failed to connect to 127.0.0.1:31001, reason: errno:61 Connection refused m31001| 2014-11-12T17:14:52.255-0500 ** WARNING: --rest is specified without --httpinterface, m31001| 2014-11-12T17:14:52.256-0500 ** enabling http interface m31001| note: noprealloc may hurt performance in many applications m31001| 2014-11-12T17:14:52.268-0500 [initandlisten] MongoDB starting : pid=10676 port=31001 dbpath=/data/db/config_validation-1 64-bit host=charlie-macbook-pro m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] db version v2.6.4 m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] git version: nogitversion m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] build info: Darwin charlie-macbook-pro 13.4.0 Darwin Kernel Version 13.4.0: Sun Aug 17 19:50:11 PDT 2014; root:xnu-2422.115.4~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] allocator: tcmalloc m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] options: { net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 31001 }, replication: { oplogSizeMB: 40, replSet: "config_validation" }, storage: { dbPath: "/data/db/config_validation-1", preallocDataFiles: false, smallFiles: true } } m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] journal dir=/data/db/config_validation-1/journal m31001| 2014-11-12T17:14:52.269-0500 [initandlisten] recover : no journal files present, no recovery needed m31001| 2014-11-12T17:14:52.286-0500 [FileAllocator] allocating new datafile /data/db/config_validation-1/local.ns, filling with zeroes... m31001| 2014-11-12T17:14:52.286-0500 [FileAllocator] creating directory /data/db/config_validation-1/_tmp m31001| 2014-11-12T17:14:52.301-0500 [FileAllocator] done allocating datafile /data/db/config_validation-1/local.ns, size: 16MB, took 0.014 secs m31001| 2014-11-12T17:14:52.331-0500 [FileAllocator] allocating new datafile /data/db/config_validation-1/local.0, filling with zeroes... m31001| 2014-11-12T17:14:52.342-0500 [FileAllocator] done allocating datafile /data/db/config_validation-1/local.0, size: 16MB, took 0.011 secs m31001| 2014-11-12T17:14:52.367-0500 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } m31001| 2014-11-12T17:14:52.368-0500 [initandlisten] added index to empty collection m31001| 2014-11-12T17:14:52.368-0500 [initandlisten] waiting for connections on port 31001 m31001| 2014-11-12T17:14:52.368-0500 [websvr] admin web console waiting for connections on port 32001 m31001| 2014-11-12T17:14:52.377-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31001| 2014-11-12T17:14:52.377-0500 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done m31001| 2014-11-12T17:14:52.431-0500 [initandlisten] connection accepted from 127.0.0.1:60171 #1 (1 connection now open) [ connection to charlie-macbook-pro:31000, connection to charlie-macbook-pro:31001 ] ReplSetTest n is : 2 ReplSetTest n: 2 ports: [ 31000, 31001, 31002 ] 31002 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31002, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "config_validation", "dbpath" : "$set-$node", "binVersion" : "2.6", "restart" : undefined, "pathOpts" : { "node" : 2, "set" : "config_validation" } } ReplSetTest Starting.... Resetting db path '/data/db/config_validation-2' 2014-11-12T17:14:52.435-0500 I - shell: started program /Users/charlie/github/mongo/mongod-2.6 --oplogSize 40 --port 31002 --noprealloc --smallfiles --rest --replSet config_validation --dbpath /data/db/config_validation-2 2014-11-12T17:14:52.436-0500 W NETWORK Failed to connect to 127.0.0.1:31002, reason: errno:61 Connection refused m31002| 2014-11-12T17:14:52.462-0500 ** WARNING: --rest is specified without --httpinterface, m31002| 2014-11-12T17:14:52.462-0500 ** enabling http interface m31002| note: noprealloc may hurt performance in many applications m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] MongoDB starting : pid=10677 port=31002 dbpath=/data/db/config_validation-2 64-bit host=charlie-macbook-pro m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] db version v2.6.4 m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] git version: nogitversion m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] build info: Darwin charlie-macbook-pro 13.4.0 Darwin Kernel Version 13.4.0: Sun Aug 17 19:50:11 PDT 2014; root:xnu-2422.115.4~1/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] allocator: tcmalloc m31002| 2014-11-12T17:14:52.477-0500 [initandlisten] options: { net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 31002 }, replication: { oplogSizeMB: 40, replSet: "config_validation" }, storage: { dbPath: "/data/db/config_validation-2", preallocDataFiles: false, smallFiles: true } } m31002| 2014-11-12T17:14:52.478-0500 [initandlisten] journal dir=/data/db/config_validation-2/journal m31002| 2014-11-12T17:14:52.478-0500 [initandlisten] recover : no journal files present, no recovery needed m31002| 2014-11-12T17:14:52.496-0500 [FileAllocator] allocating new datafile /data/db/config_validation-2/local.ns, filling with zeroes... m31002| 2014-11-12T17:14:52.496-0500 [FileAllocator] creating directory /data/db/config_validation-2/_tmp m31002| 2014-11-12T17:14:52.512-0500 [FileAllocator] done allocating datafile /data/db/config_validation-2/local.ns, size: 16MB, took 0.015 secs m31002| 2014-11-12T17:14:52.534-0500 [FileAllocator] allocating new datafile /data/db/config_validation-2/local.0, filling with zeroes... m31002| 2014-11-12T17:14:52.550-0500 [FileAllocator] done allocating datafile /data/db/config_validation-2/local.0, size: 16MB, took 0.015 secs m31002| 2014-11-12T17:14:52.573-0500 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } m31002| 2014-11-12T17:14:52.574-0500 [initandlisten] added index to empty collection m31002| 2014-11-12T17:14:52.574-0500 [initandlisten] waiting for connections on port 31002 m31002| 2014-11-12T17:14:52.575-0500 [websvr] admin web console waiting for connections on port 32002 m31002| 2014-11-12T17:14:52.585-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31002| 2014-11-12T17:14:52.585-0500 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done m31002| 2014-11-12T17:14:52.640-0500 [initandlisten] connection accepted from 127.0.0.1:60173 #1 (1 connection now open) [ connection to charlie-macbook-pro:31000, connection to charlie-macbook-pro:31001, connection to charlie-macbook-pro:31002 ] { "replSetInitiate" : { "_id" : "config_validation", "members" : [ { "_id" : 0, "host" : "charlie-macbook-pro:31000" }, { "_id" : 1, "host" : "charlie-macbook-pro:31001" }, { "_id" : 2, "host" : "charlie-macbook-pro:31002" } ] } } m31000| 2014-11-12T17:14:52.646-0500 [conn1] replSet replSetInitiate admin command received from client m31000| 2014-11-12T17:14:52.659-0500 [conn1] replSet replSetInitiate config object parses ok, 3 members specified m31001| 2014-11-12T17:14:52.660-0500 [initandlisten] connection accepted from 127.0.0.1:60174 #2 (2 connections now open) m31001| 2014-11-12T17:14:52.660-0500 [conn2] end connection 127.0.0.1:60174 (1 connection now open) m31002| 2014-11-12T17:14:52.661-0500 [initandlisten] connection accepted from 127.0.0.1:60175 #2 (2 connections now open) m31002| 2014-11-12T17:14:52.661-0500 [conn2] end connection 127.0.0.1:60175 (1 connection now open) m31001| 2014-11-12T17:14:52.661-0500 [initandlisten] connection accepted from 127.0.0.1:60176 #3 (2 connections now open) m31002| 2014-11-12T17:14:52.668-0500 [initandlisten] connection accepted from 127.0.0.1:60177 #3 (2 connections now open) m31000| 2014-11-12T17:14:52.675-0500 [conn1] replSet replSetInitiate all members seem up m31000| 2014-11-12T17:14:52.675-0500 [conn1] ****** m31000| 2014-11-12T17:14:52.675-0500 [conn1] creating replication oplog of size: 40MB... m31000| 2014-11-12T17:14:52.675-0500 [FileAllocator] allocating new datafile /data/db/config_validation-0/local.1, filling with zeroes... m31000| 2014-11-12T17:14:52.751-0500 [FileAllocator] done allocating datafile /data/db/config_validation-0/local.1, size: 64MB, took 0.075 secs m31000| 2014-11-12T17:14:52.768-0500 [conn1] ****** m31000| 2014-11-12T17:14:52.768-0500 [conn1] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 1, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31000| 2014-11-12T17:14:52.770-0500 [conn1] build index on: local.system.replset properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.system.replset" } m31000| 2014-11-12T17:14:52.771-0500 [conn1] added index to empty collection m31000| 2014-11-12T17:14:52.771-0500 [conn1] replSet saveConfigLocally done m31000| 2014-11-12T17:14:52.771-0500 [conn1] replSet replSetInitiate config now saved locally. Should come online in about a minute. m31000| 2014-11-12T17:14:52.771-0500 [conn1] command admin.$cmd command: replSetInitiate { replSetInitiate: { _id: "config_validation", members: [ { _id: 0.0, host: "charlie-macbook-pro:31000" }, { _id: 1.0, host: "charlie-macbook-pro:31001" }, { _id: 2.0, host: "charlie-macbook-pro:31002" } ] } } keyUpdates:0 numYields:0 locks(micros) W:108725 reslen:112 124ms m31000| 2014-11-12T17:14:53.229-0500 [rsStart] replSet I am charlie-macbook-pro:31000 m31000| 2014-11-12T17:14:53.244-0500 [rsStart] build index on: local.me properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.me" } m31000| 2014-11-12T17:14:53.245-0500 [rsStart] added index to empty collection m31000| 2014-11-12T17:14:53.245-0500 [rsStart] replSet STARTUP2 m31000| 2014-11-12T17:14:53.246-0500 [rsSync] replSet SECONDARY m31001| 2014-11-12T17:14:53.378-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31002| 2014-11-12T17:14:53.590-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31001| 2014-11-12T17:14:54.380-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31002| 2014-11-12T17:14:54.591-0500 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31000| 2014-11-12T17:14:55.233-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is up m31000| 2014-11-12T17:14:55.233-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is up m31000| 2014-11-12T17:14:55.234-0500 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes m31000| 2014-11-12T17:14:55.234-0500 [rsMgr] replSet not electing self, not all members up and we have been up less than 5 minutes m31000| 2014-11-12T17:14:55.385-0500 [initandlisten] connection accepted from 127.0.0.1:60187 #2 (2 connections now open) m31001| 2014-11-12T17:14:55.386-0500 [rsStart] trying to contact charlie-macbook-pro:31000 m31000| 2014-11-12T17:14:55.386-0500 [conn2] end connection 127.0.0.1:60187 (1 connection now open) m31000| 2014-11-12T17:14:55.387-0500 [initandlisten] connection accepted from 127.0.0.1:60189 #3 (2 connections now open) m31002| 2014-11-12T17:14:55.389-0500 [initandlisten] connection accepted from 127.0.0.1:60191 #4 (3 connections now open) m31001| 2014-11-12T17:14:55.389-0500 [rsStart] replSet I am charlie-macbook-pro:31001 m31002| 2014-11-12T17:14:55.389-0500 [conn4] end connection 127.0.0.1:60191 (2 connections now open) m31001| 2014-11-12T17:14:55.389-0500 [rsStart] replSet got config version 1 from a remote, saving locally m31001| 2014-11-12T17:14:55.389-0500 [rsStart] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 1, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31001| 2014-11-12T17:14:55.393-0500 [rsStart] build index on: local.system.replset properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.system.replset" } m31001| 2014-11-12T17:14:55.393-0500 [rsStart] added index to empty collection m31001| 2014-11-12T17:14:55.393-0500 [rsStart] replSet saveConfigLocally done m31001| 2014-11-12T17:14:55.406-0500 [rsStart] build index on: local.me properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.me" } m31001| 2014-11-12T17:14:55.406-0500 [rsStart] added index to empty collection m31001| 2014-11-12T17:14:55.406-0500 [rsStart] replSet STARTUP2 m31001| 2014-11-12T17:14:55.407-0500 [rsSync] ****** m31001| 2014-11-12T17:14:55.407-0500 [rsSync] creating replication oplog of size: 40MB... m31001| 2014-11-12T17:14:55.407-0500 [FileAllocator] allocating new datafile /data/db/config_validation-1/local.1, filling with zeroes... m31001| 2014-11-12T17:14:55.483-0500 [FileAllocator] done allocating datafile /data/db/config_validation-1/local.1, size: 64MB, took 0.075 secs m31001| 2014-11-12T17:14:55.539-0500 [rsSync] ****** m31001| 2014-11-12T17:14:55.539-0500 [rsSync] replSet initial sync pending m31001| 2014-11-12T17:14:55.539-0500 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m31000| 2014-11-12T17:14:55.596-0500 [initandlisten] connection accepted from 127.0.0.1:60193 #4 (3 connections now open) m31002| 2014-11-12T17:14:55.596-0500 [rsStart] trying to contact charlie-macbook-pro:31000 m31000| 2014-11-12T17:14:55.596-0500 [conn4] end connection 127.0.0.1:60193 (2 connections now open) m31000| 2014-11-12T17:14:55.597-0500 [initandlisten] connection accepted from 127.0.0.1:60194 #5 (3 connections now open) m31001| 2014-11-12T17:14:55.599-0500 [initandlisten] connection accepted from 127.0.0.1:60195 #4 (3 connections now open) m31001| 2014-11-12T17:14:55.599-0500 [conn4] end connection 127.0.0.1:60195 (2 connections now open) m31002| 2014-11-12T17:14:55.600-0500 [rsStart] replSet I am charlie-macbook-pro:31002 m31002| 2014-11-12T17:14:55.600-0500 [rsStart] replSet got config version 1 from a remote, saving locally m31002| 2014-11-12T17:14:55.600-0500 [rsStart] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 1, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31002| 2014-11-12T17:14:55.611-0500 [rsStart] build index on: local.system.replset properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.system.replset" } m31002| 2014-11-12T17:14:55.611-0500 [rsStart] added index to empty collection m31002| 2014-11-12T17:14:55.611-0500 [rsStart] replSet saveConfigLocally done m31002| 2014-11-12T17:14:55.624-0500 [rsStart] build index on: local.me properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.me" } m31002| 2014-11-12T17:14:55.624-0500 [rsStart] added index to empty collection m31002| 2014-11-12T17:14:55.624-0500 [rsStart] replSet STARTUP2 m31002| 2014-11-12T17:14:55.625-0500 [rsSync] ****** m31002| 2014-11-12T17:14:55.625-0500 [rsSync] creating replication oplog of size: 40MB... m31002| 2014-11-12T17:14:55.625-0500 [FileAllocator] allocating new datafile /data/db/config_validation-2/local.1, filling with zeroes... m31002| 2014-11-12T17:14:55.712-0500 [FileAllocator] done allocating datafile /data/db/config_validation-2/local.1, size: 64MB, took 0.085 secs m31002| 2014-11-12T17:14:55.723-0500 [rsSync] ****** m31002| 2014-11-12T17:14:55.723-0500 [rsSync] replSet initial sync pending m31002| 2014-11-12T17:14:55.723-0500 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m31000| 2014-11-12T17:14:57.239-0500 [rsHealthPoll] replset info charlie-macbook-pro:31001 thinks that we are down m31000| 2014-11-12T17:14:57.239-0500 [rsHealthPoll] replset info charlie-macbook-pro:31002 thinks that we are down m31000| 2014-11-12T17:14:57.239-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state STARTUP2 m31000| 2014-11-12T17:14:57.239-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is now in state STARTUP2 m31000| 2014-11-12T17:14:57.240-0500 [rsMgr] not electing self, charlie-macbook-pro:31002 would veto with 'I don't think charlie-macbook-pro:31000 is electable' m31000| 2014-11-12T17:14:57.240-0500 [rsMgr] not electing self, charlie-macbook-pro:31002 would veto with 'I don't think charlie-macbook-pro:31000 is electable' m31001| 2014-11-12T17:14:57.395-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is up m31001| 2014-11-12T17:14:57.395-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is now in state SECONDARY m31002| 2014-11-12T17:14:57.395-0500 [initandlisten] connection accepted from 127.0.0.1:60200 #5 (3 connections now open) m31001| 2014-11-12T17:14:57.395-0500 [rsHealthPoll] replset info charlie-macbook-pro:31002 thinks that we are down m31001| 2014-11-12T17:14:57.396-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is up m31001| 2014-11-12T17:14:57.396-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is now in state STARTUP2 m31002| 2014-11-12T17:14:57.602-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is up m31002| 2014-11-12T17:14:57.602-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is now in state SECONDARY m31001| 2014-11-12T17:14:57.603-0500 [initandlisten] connection accepted from 127.0.0.1:60201 #5 (3 connections now open) m31002| 2014-11-12T17:14:57.603-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is up m31002| 2014-11-12T17:14:57.603-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state STARTUP2 m31000| 2014-11-12T17:15:03.249-0500 [rsMgr] replSet info electSelf 0 m31002| 2014-11-12T17:15:03.249-0500 [conn3] replSet info voting yea for charlie-macbook-pro:31000 (0) m31001| 2014-11-12T17:15:03.249-0500 [conn3] replSet info voting yea for charlie-macbook-pro:31000 (0) m31000| 2014-11-12T17:15:03.280-0500 [rsMgr] replSet PRIMARY m31001| 2014-11-12T17:15:03.401-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is now in state PRIMARY m31002| 2014-11-12T17:15:03.613-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31000 is now in state PRIMARY m31001| 2014-11-12T17:15:09.263-0500 [conn3] end connection 127.0.0.1:60176 (2 connections now open) m31001| 2014-11-12T17:15:09.263-0500 [initandlisten] connection accepted from 127.0.0.1:60281 #6 (3 connections now open) m31000| 2014-11-12T17:15:11.419-0500 [conn3] end connection 127.0.0.1:60189 (2 connections now open) m31000| 2014-11-12T17:15:11.420-0500 [initandlisten] connection accepted from 127.0.0.1:60294 #6 (3 connections now open) m31001| 2014-11-12T17:15:11.549-0500 [rsSync] replSet initial sync pending m31001| 2014-11-12T17:15:11.549-0500 [rsSync] replSet syncing to: charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:11.550-0500 [initandlisten] connection accepted from 127.0.0.1:60295 #7 (4 connections now open) m31001| 2014-11-12T17:15:11.554-0500 [rsSync] build index on: local.replset.minvalid properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.replset.minvalid" } m31001| 2014-11-12T17:15:11.555-0500 [rsSync] added index to empty collection m31001| 2014-11-12T17:15:11.555-0500 [rsSync] replSet initial sync drop all databases m31001| 2014-11-12T17:15:11.556-0500 [rsSync] dropAllDatabasesExceptLocal 1 m31001| 2014-11-12T17:15:11.556-0500 [rsSync] replSet initial sync clone all databases m31001| 2014-11-12T17:15:11.556-0500 [rsSync] replSet initial sync cloning db: admin m31000| 2014-11-12T17:15:11.557-0500 [initandlisten] connection accepted from 127.0.0.1:60296 #8 (5 connections now open) m31001| 2014-11-12T17:15:11.557-0500 [rsSync] replSet initial sync data copy, starting syncup m31001| 2014-11-12T17:15:11.557-0500 [rsSync] oplog sync 1 of 3 m31001| 2014-11-12T17:15:11.558-0500 [rsSync] oplog sync 2 of 3 m31001| 2014-11-12T17:15:11.558-0500 [rsSync] replSet initial sync building indexes m31001| 2014-11-12T17:15:11.558-0500 [rsSync] replSet initial sync cloning indexes for : admin m31001| 2014-11-12T17:15:11.558-0500 [rsSync] oplog sync 3 of 3 m31000| 2014-11-12T17:15:11.558-0500 [conn8] end connection 127.0.0.1:60296 (4 connections now open) m31001| 2014-11-12T17:15:11.558-0500 [rsSync] replSet initial sync finishing up m31001| 2014-11-12T17:15:11.561-0500 [rsSync] replSet set minValid=5463dbdc:b m31001| 2014-11-12T17:15:11.563-0500 [rsSync] replSet RECOVERING m31001| 2014-11-12T17:15:11.563-0500 [rsSync] replSet initial sync done m31000| 2014-11-12T17:15:11.563-0500 [conn7] end connection 127.0.0.1:60295 (3 connections now open) m31000| 2014-11-12T17:15:11.624-0500 [conn5] end connection 127.0.0.1:60194 (2 connections now open) m31002| 2014-11-12T17:15:11.624-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state RECOVERING m31000| 2014-11-12T17:15:11.625-0500 [initandlisten] connection accepted from 127.0.0.1:60297 #9 (3 connections now open) m31002| 2014-11-12T17:15:11.730-0500 [rsSync] replSet initial sync pending m31002| 2014-11-12T17:15:11.730-0500 [rsSync] replSet syncing to: charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:11.731-0500 [initandlisten] connection accepted from 127.0.0.1:60298 #10 (4 connections now open) m31002| 2014-11-12T17:15:11.736-0500 [rsSync] build index on: local.replset.minvalid properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.replset.minvalid" } m31002| 2014-11-12T17:15:11.736-0500 [rsSync] added index to empty collection m31002| 2014-11-12T17:15:11.736-0500 [rsSync] replSet initial sync drop all databases m31002| 2014-11-12T17:15:11.737-0500 [rsSync] dropAllDatabasesExceptLocal 1 m31002| 2014-11-12T17:15:11.737-0500 [rsSync] replSet initial sync clone all databases m31002| 2014-11-12T17:15:11.738-0500 [rsSync] replSet initial sync cloning db: admin m31000| 2014-11-12T17:15:11.739-0500 [initandlisten] connection accepted from 127.0.0.1:60299 #11 (5 connections now open) m31002| 2014-11-12T17:15:11.739-0500 [rsSync] replSet initial sync data copy, starting syncup m31002| 2014-11-12T17:15:11.739-0500 [rsSync] oplog sync 1 of 3 m31002| 2014-11-12T17:15:11.740-0500 [rsSync] oplog sync 2 of 3 m31002| 2014-11-12T17:15:11.740-0500 [rsSync] replSet initial sync building indexes m31002| 2014-11-12T17:15:11.740-0500 [rsSync] replSet initial sync cloning indexes for : admin m31002| 2014-11-12T17:15:11.740-0500 [rsSync] oplog sync 3 of 3 m31000| 2014-11-12T17:15:11.740-0500 [conn11] end connection 127.0.0.1:60299 (4 connections now open) m31002| 2014-11-12T17:15:11.740-0500 [rsSync] replSet initial sync finishing up m31002| 2014-11-12T17:15:11.744-0500 [rsSync] replSet set minValid=5463dbdc:b m31002| 2014-11-12T17:15:11.746-0500 [rsSync] replSet RECOVERING m31002| 2014-11-12T17:15:11.746-0500 [rsSync] replSet initial sync done m31000| 2014-11-12T17:15:11.746-0500 [conn10] end connection 127.0.0.1:60298 (3 connections now open) m31001| 2014-11-12T17:15:12.459-0500 [rsBackgroundSync] replSet syncing to: charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:12.460-0500 [initandlisten] connection accepted from 127.0.0.1:60302 #12 (4 connections now open) m31001| 2014-11-12T17:15:12.460-0500 [rsBackgroundSync] replset setting syncSourceFeedback to charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:12.461-0500 [initandlisten] connection accepted from 127.0.0.1:60303 #13 (5 connections now open) m31001| 2014-11-12T17:15:12.564-0500 [rsSync] replSet SECONDARY m31002| 2014-11-12T17:15:12.660-0500 [rsBackgroundSync] replSet syncing to: charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:12.661-0500 [initandlisten] connection accepted from 127.0.0.1:60304 #14 (6 connections now open) m31002| 2014-11-12T17:15:12.661-0500 [rsBackgroundSync] replset setting syncSourceFeedback to charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:12.662-0500 [initandlisten] connection accepted from 127.0.0.1:60305 #15 (7 connections now open) m31002| 2014-11-12T17:15:12.749-0500 [rsSync] replSet SECONDARY m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet replSetReconfig config object parses ok, 3 members specified m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet replSetReconfig [2] m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 2, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet saveConfigLocally done m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet info : additive change to configuration m31000| 2014-11-12T17:15:12.872-0500 [conn1] replSet replSetReconfig new config saved locally ReplSetTest awaitReplication: starting: timestamp for primary, charlie-macbook-pro:31000, is Timestamp(1415830512, 1) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830512, 1) ReplSetTest awaitReplication: secondary #0, undefined, has config version #1, but expected config version #2 ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830512, 1) ReplSetTest awaitReplication: secondary #0, undefined, has config version #1, but expected config version #2 m31000| 2014-11-12T17:15:13.271-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state SECONDARY m31000| 2014-11-12T17:15:13.271-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is now in state SECONDARY ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830512, 1) ReplSetTest awaitReplication: secondary #0, undefined, has config version #1, but expected config version #2 m31001| 2014-11-12T17:15:13.422-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31002 is now in state SECONDARY m31001| 2014-11-12T17:15:13.425-0500 [rsMgr] replset msgReceivedNewConfig version: version: 2 m31001| 2014-11-12T17:15:13.425-0500 [rsMgr] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 2, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31001| 2014-11-12T17:15:13.426-0500 [rsMgr] replSet saveConfigLocally done m31001| 2014-11-12T17:15:13.426-0500 [rsMgr] replSet info : additive change to configuration m31001| 2014-11-12T17:15:13.426-0500 [rsMgr] replSet replSetReconfig new config saved locally ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830512, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is synced ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, has config version #1, but expected config version #2 m31000| 2014-11-12T17:15:13.571-0500 [slaveTracking] build index on: local.slaves properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.slaves" } m31000| 2014-11-12T17:15:13.572-0500 [slaveTracking] added index to empty collection m31002| 2014-11-12T17:15:13.630-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state SECONDARY m31002| 2014-11-12T17:15:13.630-0500 [rsMgr] replset msgReceivedNewConfig version: version: 2 m31002| 2014-11-12T17:15:13.630-0500 [rsMgr] replSet info saving a newer config version to local.system.replset: { _id: "config_validation", version: 2, members: [ { _id: 0, host: "charlie-macbook-pro:31000" }, { _id: 1, host: "charlie-macbook-pro:31001" }, { _id: 2, host: "charlie-macbook-pro:31002" } ] } m31002| 2014-11-12T17:15:13.631-0500 [rsMgr] replSet saveConfigLocally done m31002| 2014-11-12T17:15:13.631-0500 [rsMgr] replSet info : additive change to configuration m31002| 2014-11-12T17:15:13.631-0500 [rsMgr] replSet replSetReconfig new config saved locally m31002| 2014-11-12T17:15:13.631-0500 [rsMgr] replset msgReceivedNewConfig version: version: 2 m31002| 2014-11-12T17:15:13.631-0500 [rsMgr] replSet info msgReceivedNewConfig but version isn't higher 2 2 ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830512, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is synced ReplSetTest awaitReplication: checking secondary #2: charlie-macbook-pro:31002 ReplSetTest awaitReplication: secondary #2, charlie-macbook-pro:31002, is synced ReplSetTest awaitReplication: finished: all 2 secondaries synced at timestamp Timestamp(1415830512, 1) ReplSetTest n: 1 ports: [ 31000, 31001, 31002 ] 31001 number ReplSetTest stop *** Shutting down mongod in port 31001 *** m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] now exiting m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] dbexit: m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] shutdown: going to close listening sockets... m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] closing listening socket: 17 m31001| 2014-11-12T17:15:13.706-0500 [signalProcessingThread] closing listening socket: 18 m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] closing listening socket: 21 m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] removing socket file: /tmp/mongodb-31001.sock m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] shutdown: going to flush diaglog... m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] shutdown: going to close sockets... m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] shutdown: waiting for fs preallocator... m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] shutdown: lock for final commit... m31001| 2014-11-12T17:15:13.707-0500 [signalProcessingThread] shutdown: final commit... m31001| 2014-11-12T17:15:13.707-0500 [conn1] end connection 127.0.0.1:60171 (2 connections now open) m31001| 2014-11-12T17:15:13.707-0500 [conn6] end connection 127.0.0.1:60281 (2 connections now open) m31001| 2014-11-12T17:15:13.708-0500 [conn5] end connection 127.0.0.1:60201 (2 connections now open) m31001| 2014-11-12T17:15:13.708-0500 [rsBackgroundSync] Socket recv() errno:9 Bad file descriptor 127.0.0.1:31000 m31001| 2014-11-12T17:15:13.708-0500 [rsBackgroundSync] SocketException: remote: 127.0.0.1:31000 error: 9001 socket exception [RECV_ERROR] server [127.0.0.1:31000] m31001| 2014-11-12T17:15:13.708-0500 [rsBackgroundSync] replSet sync source problem: 10278 dbclient error communicating with server: charlie-macbook-pro:31000 m31000| 2014-11-12T17:15:13.708-0500 [conn6] end connection 127.0.0.1:60294 (6 connections now open) m31000| 2014-11-12T17:15:13.708-0500 [conn13] end connection 127.0.0.1:60303 (5 connections now open) m31002| 2014-11-12T17:15:13.708-0500 [conn5] end connection 127.0.0.1:60200 (2 connections now open) m31001| 2014-11-12T17:15:13.715-0500 [signalProcessingThread] shutdown: closing all files... m31001| 2014-11-12T17:15:13.716-0500 [signalProcessingThread] closeAllFiles() finished m31001| 2014-11-12T17:15:13.716-0500 [signalProcessingThread] journalCleanup... m31001| 2014-11-12T17:15:13.716-0500 [signalProcessingThread] removeJournalFiles m31001| 2014-11-12T17:15:13.716-0500 [signalProcessingThread] shutdown: removing fs lock... m31001| 2014-11-12T17:15:13.717-0500 [signalProcessingThread] dbexit: really exiting now 2014-11-12T17:15:14.709-0500 I - shell: stopped mongo program on port 31001 ReplSetTest stop *** Mongod in port 31001 shutdown with code (0) *** ReplSetTest n is : 1 ReplSetTest n: 1 ports: [ 31000, 31001, 31002 ] 31001 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31001, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "config_validation", "dbpath" : "$set-$node", "binVersion" : "latest", "restart" : true, "pathOpts" : { "node" : 1, "set" : "config_validation" } } ReplSetTest (Re)Starting.... 2014-11-12T17:15:14.711-0500 I - shell: started program /Users/charlie/github/mongo/mongod --oplogSize 40 --port 31001 --noprealloc --smallfiles --rest --replSet config_validation --dbpath /data/db/config_validation-1 --setParameter enableTestCommands=1 2014-11-12T17:15:14.712-0500 W NETWORK Failed to connect to 127.0.0.1:31001, reason: errno:61 Connection refused m31001| 2014-11-12T17:15:14.725-0500 I CONTROL ** WARNING: --rest is specified without --httpinterface, m31001| 2014-11-12T17:15:14.725-0500 I CONTROL ** enabling http interface m31001| note: noprealloc may hurt performance in many applications m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] MongoDB starting : pid=10678 port=31001 dbpath=/data/db/config_validation-1 64-bit host=charlie-macbook-pro m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] ** NOTE: This is a development version (2.7.9-pre-) of MongoDB. m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] ** Not recommended for production. m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] db version v2.7.9-pre- m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] git version: 04869a65202864514e6066ef77798a39c7c4920d m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] build info: Darwin charlie-macbook-pro 14.0.0 Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 x86_64 BOOST_LIB_VERSION=1_49 m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] allocator: tcmalloc m31001| 2014-11-12T17:15:14.730-0500 I CONTROL [initandlisten] options: { net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 31001 }, replication: { oplogSizeMB: 40, replSet: "config_validation" }, setParameter: { enableTestCommands: "1" }, storage: { dbPath: "/data/db/config_validation-1", mmapv1: { preallocDataFiles: false, smallFiles: true } } } m31001| 2014-11-12T17:15:14.731-0500 I JOURNAL [initandlisten] journal dir=/data/db/config_validation-1/journal m31001| 2014-11-12T17:15:14.731-0500 I JOURNAL [initandlisten] recover : no journal files present, no recovery needed m31001| 2014-11-12T17:15:14.809-0500 I NETWORK [websvr] admin web console waiting for connections on port 32001 m31001| 2014-11-12T17:15:14.809-0500 I REPLSETS [rsSync] replSet warning did not receive a valid config yet, sleeping 5 seconds m31001| 2014-11-12T17:15:14.810-0500 I NETWORK [initandlisten] waiting for connections on port 31001 m31000| 2014-11-12T17:15:14.810-0500 [initandlisten] connection accepted from 127.0.0.1:60319 #16 (6 connections now open) m31000| 2014-11-12T17:15:14.811-0500 [conn16] end connection 127.0.0.1:60319 (5 connections now open) m31002| 2014-11-12T17:15:14.812-0500 [initandlisten] connection accepted from 127.0.0.1:60320 #6 (3 connections now open) m31001| 2014-11-12T17:15:14.812-0500 I REPLSETS [ReplicationExecutor] transition to STARTUP2 m31002| 2014-11-12T17:15:14.812-0500 [conn6] end connection 127.0.0.1:60320 (2 connections now open) m31002| 2014-11-12T17:15:14.813-0500 [initandlisten] connection accepted from 127.0.0.1:60321 #7 (3 connections now open) m31000| 2014-11-12T17:15:14.813-0500 [initandlisten] connection accepted from 127.0.0.1:60322 #17 (6 connections now open) m31001| 2014-11-12T17:15:14.917-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60323 #1 (1 connection now open) [ connection to charlie-macbook-pro:31000, connection to charlie-macbook-pro:31001, connection to charlie-macbook-pro:31002 ] ReplSetTest waitForIndicator state on connection to charlie-macbook-pro:31001 [ 1, 2, 7 ] ReplSetTest waitForIndicator from node connection to charlie-macbook-pro:31001 ReplSetTest waitForIndicator Initial status ( timeout : 30000 ) : { "set" : "config_validation", "date" : ISODate("2014-11-12T22:15:14Z"), "myState" : 1, "members" : [ { "_id" : 0, "name" : "charlie-macbook-pro:31000", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 22, "optime" : Timestamp(1415830512, 1), "optimeDate" : ISODate("2014-11-12T22:15:12Z"), "electionTime" : Timestamp(1415830503, 1), "electionDate" : ISODate("2014-11-12T22:15:03Z"), "self" : true }, { "_id" : 1, "name" : "charlie-macbook-pro:31001", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 19, "optime" : Timestamp(1415830512, 1), "optimeDate" : ISODate("2014-11-12T22:15:12Z"), "lastHeartbeat" : ISODate("2014-11-12T22:15:13Z"), "lastHeartbeatRecv" : ISODate("2014-11-12T22:15:14Z"), "pingMs" : 0, "syncingTo" : "charlie-macbook-pro:31000" }, { "_id" : 2, "name" : "charlie-macbook-pro:31002", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 19, "optime" : Timestamp(1415830512, 1), "optimeDate" : ISODate("2014-11-12T22:15:12Z"), "lastHeartbeat" : ISODate("2014-11-12T22:15:13Z"), "lastHeartbeatRecv" : ISODate("2014-11-12T22:15:13Z"), "pingMs" : 0, "syncingTo" : "charlie-macbook-pro:31000" } ], "ok" : 1 } Status for : charlie-macbook-pro:31000, checking charlie-macbook-pro:31001/charlie-macbook-pro:31001 Status for : charlie-macbook-pro:31001, checking charlie-macbook-pro:31001/charlie-macbook-pro:31001 Status : 2 target state : 1 Status : 2 target state : 2 ReplSetTest waitForIndicator final status: undefined got here now! m31000| 2014-11-12T17:15:14.924-0500 [FileAllocator] allocating new datafile /data/db/config_validation-0/foo.ns, filling with zeroes... m31000| 2014-11-12T17:15:14.945-0500 [FileAllocator] done allocating datafile /data/db/config_validation-0/foo.ns, size: 16MB, took 0.02 secs m31000| 2014-11-12T17:15:14.969-0500 [FileAllocator] allocating new datafile /data/db/config_validation-0/foo.0, filling with zeroes... m31000| 2014-11-12T17:15:14.985-0500 [FileAllocator] done allocating datafile /data/db/config_validation-0/foo.0, size: 16MB, took 0.015 secs m31000| 2014-11-12T17:15:15.007-0500 [conn1] build index on: foo.bar properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "foo.bar" } m31000| 2014-11-12T17:15:15.008-0500 [conn1] added index to empty collection m31000| 2014-11-12T17:15:15.008-0500 [conn12] end connection 127.0.0.1:60302 (5 connections now open) m31002| 2014-11-12T17:15:15.008-0500 [FileAllocator] allocating new datafile /data/db/config_validation-2/foo.ns, filling with zeroes... ReplSetTest awaitReplication: starting: timestamp for primary, charlie-macbook-pro:31000, is Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31002| 2014-11-12T17:15:15.024-0500 [FileAllocator] done allocating datafile /data/db/config_validation-2/foo.ns, size: 16MB, took 0.015 secs m31002| 2014-11-12T17:15:15.048-0500 [FileAllocator] allocating new datafile /data/db/config_validation-2/foo.0, filling with zeroes... m31002| 2014-11-12T17:15:15.062-0500 [FileAllocator] done allocating datafile /data/db/config_validation-2/foo.0, size: 16MB, took 0.013 secs m31002| 2014-11-12T17:15:15.087-0500 [repl writer worker 1] build index on: foo.bar properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "foo.bar" } m31002| 2014-11-12T17:15:15.088-0500 [repl writer worker 1] added index to empty collection ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31000| 2014-11-12T17:15:15.273-0500 [rsHealthPoll] DBClientCursor::init call() failed m31000| 2014-11-12T17:15:15.273-0500 [rsHealthPoll] replset info charlie-macbook-pro:31001 heartbeat failed, retrying m31001| 2014-11-12T17:15:15.276-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60324 #2 (2 connections now open) m31000| 2014-11-12T17:15:15.276-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state STARTUP2 ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31002| 2014-11-12T17:15:15.634-0500 [rsHealthPoll] DBClientCursor::init call() failed m31002| 2014-11-12T17:15:15.634-0500 [rsHealthPoll] replset info charlie-macbook-pro:31001 heartbeat failed, retrying m31001| 2014-11-12T17:15:15.636-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60327 #3 (3 connections now open) m31002| 2014-11-12T17:15:15.636-0500 [rsHealthPoll] replSet member charlie-macbook-pro:31001 is now in state STARTUP2 ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31001| 2014-11-12T17:15:17.822-0500 I REPLSETS [ReplicationExecutor] syncing from: charlie-macbook-pro:31002 m31002| 2014-11-12T17:15:17.823-0500 [initandlisten] connection accepted from 127.0.0.1:60340 #8 (4 connections now open) m31001| 2014-11-12T17:15:17.823-0500 I REPLSETS [SyncSourceFeedback] replset setting syncSourceFeedback to charlie-macbook-pro:31002 m31002| 2014-11-12T17:15:17.824-0500 [initandlisten] connection accepted from 127.0.0.1:60341 #9 (5 connections now open) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31002| 2014-11-12T17:15:18.832-0500 [slaveTracking] build index on: local.slaves properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.slaves" } m31002| 2014-11-12T17:15:18.832-0500 [slaveTracking] added index to empty collection ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31001 ReplSetTest awaitReplication: timestamp for secondary #1, charlie-macbook-pro:31001, is Timestamp(1415830512, 1) but latest is Timestamp(1415830515, 1) ReplSetTest awaitReplication: last oplog entry (of 2) for secondary #1, charlie-macbook-pro:31001, is { "ts" : Timestamp(1415830512, 1), "h" : NumberLong("-7304386765035405295"), "v" : 2, "op" : "n", "ns" : "", "o" : { "msg" : "Reconfig set", "version" : 2 } } ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31001, is NOT synced m31001| 2014-11-12T17:15:19.812-0500 I REPLSETS [ReplicationExecutor] transition to RECOVERING m31001| 2014-11-12T17:15:19.813-0500 I REPLSETS [ReplicationExecutor] transition to SECONDARY m31001| 2014-11-12T17:15:19.813-0500 F - [repl prefetch worker 15] Invalid access at address: 0 m31001| 2014-11-12T17:15:19.816-0500 F - [repl prefetch worker 15] Got signal: 11 (Segmentation fault: 11). m31001| m31001| 0x10799012a 0x10798fbb0 0x7fff8f8f1f1a 0x108317350 0x1074efbcf 0x107680494 0x107922a12 0x1079d1571 0x7fff8981f2fc 0x7fff8981f279 0x7fff8981d4b1 m31001| ----- BEGIN BACKTRACE ----- m31001| {"backtrace":[{"b":"107086000","o":"90A12A"},{"b":"107086000","o":"909BB0"},{"b":"7FFF8F8ED000","o":"4F1A"},{"b":"107086000","o":"1291350"},{"b":"107086000","o":"469BCF"},{"b":"107086000","o":"5FA494"},{"b":"107086000","o":"89CA12"},{"b":"107086000","o":"94B571"},{"b":"7FFF8981C000","o":"32FC"},{"b":"7FFF8981C000","o":"3279"},{"b":"7FFF8981C000","o":"14B1"}],"processInfo":{ "mongodbVersion" : "2.7.9-pre-", "gitVersion" : "04869a65202864514e6066ef77798a39c7c4920d", "uname" : { "sysname" : "Darwin", "release" : "14.0.0", "version" : "Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64", "machine" : "x86_64" }, "somap" : [ { "path" : "/Users/charlie/github/mongo/mongod", "machType" : 2, "b" : "107086000", "buildId" : "E1D66906875A3E53BE2B8B8BE4E26687" }, { "path" : "/usr/lib/libSystem.B.dylib", "machType" : 6, "b" : "7FFF96B38000", "buildId" : "DA954461EC6A3DF085516FC810627627" }, { "path" : "/usr/lib/libstdc++.6.dylib", "machType" : 6, "b" : "7FFF9677E000", "buildId" : "803F6AC887DC3E249E80729B551F6FFF" }, { "path" : "/usr/lib/system/libcache.dylib", "machType" : 6, "b" : "7FFF89B38000", "buildId" : "45E9A2E799C436B2BEE30C4E11614AD1" }, { "path" : "/usr/lib/system/libcommonCrypto.dylib", "machType" : 6, "b" : "7FFF922AA000", "buildId" : "D381EBC669D831D380845A80A32CB748" }, { "path" : "/usr/lib/system/libcompiler_rt.dylib", "machType" : 6, "b" : "7FFF941AD000", "buildId" : "BF8FC133EE103DA69B9092039E28678F" }, { "path" : "/usr/lib/system/libcopyfile.dylib", "machType" : 6, "b" : "7FFF95623000", "buildId" : "0C68D3A6ACDD3EF3991ACC82C32AB836" }, { "path" : "/usr/lib/system/libcorecrypto.dylib", "machType" : 6, "b" : "7FFF91A37000", "buildId" : "E178980139853949B7366B3378873301" }, { "path" : "/usr/lib/system/libdispatch.dylib", "machType" : 6, "b" : "7FFF941C4000", "buildId" : "502CF32B669B3709886208188225E4F0" }, { "path" : "/usr/lib/system/libdyld.dylib", "machType" : 6, "b" : "7FFF8AF81000", "buildId" : "19FAF435C16533749DEFD7BBA7D61DB6" }, { "path" : "/usr/lib/system/libkeymgr.dylib", "machType" : 6, "b" : "7FFF8D912000", "buildId" : "77845842DE703CC5BD01C3D14227CED5" }, { "path" : "/usr/lib/system/liblaunch.dylib", "machType" : 6, "b" : "7FFF9562E000", "buildId" : "8A9889248BE735FEBF7D322E90EFE49E" }, { "path" : "/usr/lib/system/libmacho.dylib", "machType" : 6, "b" : "7FFF96B32000", "buildId" : "126CA2EDDE91308F8881B9DAEC3C63B6" }, { "path" : "/usr/lib/system/libquarantine.dylib", "machType" : 6, "b" : "7FFF8D1B3000", "buildId" : "DC0416272D92361CBABFA869A5C72293" }, { "path" : "/usr/lib/system/libremovefile.dylib", "machType" : 6, "b" : "7FFF9417C000", "buildId" : "3485B5F46CE83C628DFD8736ED6E8531" }, { "path" : "/usr/lib/system/libsystem_asl.dylib", "machType" : 6, "b" : "7FFF8F8D6000", "buildId" : "F153AC5B0542356E88C820A62CA704E2" }, { "path" : "/usr/lib/system/libsystem_blocks.dylib", "machType" : 6, "b" : "7FFF8D6DA000", "buildId" : "9615D10AFCA73BE4AA1A1B195DACE1A1" }, { "path" : "/usr/lib/system/libsystem_c.dylib", "machType" : 6, "b" : "7FFF97F65000", "buildId" : "C185E86274243210B5286B822577A4B8" }, { "path" : "/usr/lib/system/libsystem_configuration.dylib", "machType" : 6, "b" : "7FFF8FB41000", "buildId" : "9FBA1CE497D0347EA44393ED94512E92" }, { "path" : "/usr/lib/system/libsystem_coreservices.dylib", "machType" : 6, "b" : "7FFF912F5000", "buildId" : "41B7C5785A5331C8A96FC73E030B0938" }, { "path" : "/usr/lib/system/libsystem_coretls.dylib", "machType" : 6, "b" : "7FFF8998D000", "buildId" : "EBBF7EF680D83F8F825CB412BD6D22C0" }, { "path" : "/usr/lib/system/libsystem_dnssd.dylib", "machType" : 6, "b" : "7FFF98DAD000", "buildId" : "62B70ECAE40D3C63896E7F00EC386DDB" }, { "path" : "/usr/lib/system/libsystem_info.dylib", "machType" : 6, "b" : "7FFF936B2000", "buildId" : "B85A85D585303A93B0C34DEC41F79478" }, { "path" : "/usr/lib/system/libsystem_kernel.dylib", "machType" : 6, "b" : "7FFF93107000", "buildId" : "93E0E0A975B63904BB4E4BC7C05F4B6B" }, { "path" : "/usr/lib/system/libsystem_m.dylib", "machType" : 6, "b" : "7FFF8C851000", "buildId" : "1E12AB456D9636D0A226F24D9FB0D9D6" }, { "path" : "/usr/lib/system/libsystem_malloc.dylib", "machType" : 6, "b" : "7FFF922C7000", "buildId" : "19BCC25757173502A71F95D65AFA861B" }, { "path" : "/usr/lib/system/libsystem_network.dylib", "machType" : 6, "b" : "7FFF9116E000", "buildId" : "C0B2313D47BE38A9BEE62634A4F5E14B" }, { "path" : "/usr/lib/system/libsystem_networkextension.dylib", "machType" : 6, "b" : "7FFF92CA1000", "buildId" : "29AB225BD7FB30ED960065D44B9A9442" }, { "path" : "/usr/lib/system/libsystem_notify.dylib", "machType" : 6, "b" : "7FFF8BDAE000", "buildId" : "61147800F3203DAA850CBADF33855F29" }, { "path" : "/usr/lib/system/libsystem_platform.dylib", "machType" : 6, "b" : "7FFF8F8ED000", "buildId" : "64E34079D7123D669CE2418624A5C040" }, { "path" : "/usr/lib/system/libsystem_pthread.dylib", "machType" : 6, "b" : "7FFF8981C000", "buildId" : "26B1897F0CD330F3B55A37CB45062D73" }, { "path" : "/usr/lib/system/libsystem_sandbox.dylib", "machType" : 6, "b" : "7FFF901BC000", "buildId" : "DB9962EF889831CC9B87E01F8CE74C9D" }, { "path" : "/usr/lib/system/libsystem_secinit.dylib", "machType" : 6, "b" : "7FFF98C79000", "buildId" : "581DAD0F6B633A48B63B917AF799ABAA" }, { "path" : "/usr/lib/system/libsystem_stats.dylib", "machType" : 6, "b" : "7FFF94333000", "buildId" : "1DB0443659743F1686CC5FF5F390339C" }, { "path" : "/usr/lib/system/libsystem_trace.dylib", "machType" : 6, "b" : "7FFF97521000", "buildId" : "A9E6B7D8C3273742AC5486C94218B1DF" }, { "path" : "/usr/lib/system/libunc.dylib", "machType" : 6, "b" : "7FFF91A0E000", "buildId" : "5676F7EAC1DF329FB006D2C3022B7D70" }, { "path" : "/usr/lib/system/libunwind.dylib", "machType" : 6, "b" : "7FFF8999F000", "buildId" : "BE7E51A0B6EA3A549CCA9D88F683A6D6" }, { "path" : "/usr/lib/system/libxpc.dylib", "machType" : 6, "b" : "7FFF952A7000", "buildId" : "9437C02EA07B38C891CB299FAA63083D" }, { "path" : "/usr/lib/libobjc.A.dylib", "machType" : 6, "b" : "7FFF93125000", "buildId" : "3B60CD9074A23A5D9686B0772159792A" }, { "path" : "/usr/lib/libauto.dylib", "machType" : 6, "b" : "7FFF97888000", "buildId" : "A260789BD4D8316A9490254767B8A5F1" }, { "path" : "/usr/lib/libc++abi.dylib", "machType" : 6, "b" : "7FFF8FE7A000", "buildId" : "88A22A0F87C63002BFBAAC0F2808B8B9" }, { "path" : "/usr/lib/libc++.1.dylib", "machType" : 6, "b" : "7FFF90122000", "buildId" : "1B9530FD989B3174BB1CBDC159501710" }, { "path" : "/usr/lib/libDiagnosticMessagesClient.dylib", "machType" : 6, "b" : "7FFF8AF96000", "buildId" : "2EE8E4365CDC34C599595BA218D507FB" } ] }} m31001| mongod(_ZN5mongo15printStackTraceERSo+0x3A) [0x10799012a] m31001| mongod(_ZN5mongo12_GLOBAL__N_124abruptQuitWithAddrSignalEiP9__siginfoPv+0x240) [0x10798fbb0] m31001| libsystem_platform.dylib(_sigtramp+0x1A) [0x7fff8f8f1f1a] m31001| mongod(_ZN8tcmalloc6Static14central_cache_E+0x2180) [0x108317350] m31001| mongod(_ZN5mongo4repl28prefetchPagesForReplicatedOpEPNS_16OperationContextEPNS_8DatabaseERKNS_7BSONObjE+0x13F) [0x1074efbcf] m31001| mongod(_ZN5mongo4repl8SyncTail10prefetchOpERKNS_7BSONObjE+0xC4) [0x107680494] m31001| mongod(_ZN5mongo10threadpool6Worker4loopERKSs+0x92) [0x107922a12] m31001| mongod(_ZN5boost12_GLOBAL__N_112thread_proxyEPv+0xB1) [0x1079d1571] m31001| libsystem_pthread.dylib(_pthread_body+0x83) [0x7fff8981f2fc] m31001| libsystem_pthread.dylib(_pthread_body+0x0) [0x7fff8981f279] m31001| libsystem_pthread.dylib(thread_start+0xD) [0x7fff8981d4b1] m31001| ----- END BACKTRACE ----- m31002| 2014-11-12T17:15:19.820-0500 [conn9] end connection 127.0.0.1:60341 (4 connections now open) m31002| 2014-11-12T17:15:19.820-0500 [conn7] end connection 127.0.0.1:60321 (3 connections now open) m31000| 2014-11-12T17:15:19.820-0500 [conn17] end connection 127.0.0.1:60322 (4 connections now open) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) 2014-11-12T17:15:19.946-0500 I NETWORK DBClientCursor::init call() failed ReplSetTest awaitReplication: caught exception: Error: error doing query: failed 2014-11-12T17:15:19.948-0500 I NETWORK trying reconnect to 127.0.0.1:31001 (127.0.0.1) failed 2014-11-12T17:15:19.948-0500 W NETWORK Failed to connect to 127.0.0.1:31001, reason: errno:61 Connection refused 2014-11-12T17:15:19.948-0500 I NETWORK reconnect 127.0.0.1:31001 (127.0.0.1) failed failed couldn't connect to server 127.0.0.1:31001 (127.0.0.1), connection attempt failed ReplSetTest Could not call ismaster on node 1: Error: socket exception [CONNECT_ERROR] for 127.0.0.1:31001 (127.0.0.1) failed ReplSetTest awaitReplication: resetting: timestamp for primary connection to charlie-macbook-pro:31000 is Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondaries against timestamp Timestamp(1415830515, 1) ReplSetTest awaitReplication: checking secondary #1: charlie-macbook-pro:31002 ReplSetTest awaitReplication: secondary #1, charlie-macbook-pro:31002, is synced ReplSetTest awaitReplication: finished: all 1 secondaries synced at timestamp Timestamp(1415830515, 1) and here now! m31000| 2014-11-12T17:15:20.150-0500 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m31000| 2014-11-12T17:15:20.150-0500 [signalProcessingThread] now exiting m31000| 2014-11-12T17:15:20.150-0500 [signalProcessingThread] dbexit: m31000| 2014-11-12T17:15:20.150-0500 [signalProcessingThread] shutdown: going to close listening sockets... m31000| 2014-11-12T17:15:20.150-0500 [signalProcessingThread] closing listening socket: 13 m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] closing listening socket: 14 m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] closing listening socket: 18 m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] removing socket file: /tmp/mongodb-31000.sock m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] shutdown: going to flush diaglog... m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] shutdown: going to close sockets... m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] shutdown: waiting for fs preallocator... m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] shutdown: lock for final commit... m31000| 2014-11-12T17:15:20.151-0500 [signalProcessingThread] shutdown: final commit... m31000| 2014-11-12T17:15:20.151-0500 [conn15] end connection 127.0.0.1:60305 (3 connections now open) m31000| 2014-11-12T17:15:20.151-0500 [conn1] end connection 127.0.0.1:60167 (3 connections now open) m31000| 2014-11-12T17:15:20.151-0500 [conn9] end connection 127.0.0.1:60297 (3 connections now open) m31002| 2014-11-12T17:15:20.151-0500 [conn3] end connection 127.0.0.1:60177 (2 connections now open) m31002| 2014-11-12T17:15:20.151-0500 [rsBackgroundSync] replSet sync source problem: 10278 dbclient error communicating with server: charlie-macbook-pro:31000 m31002| 2014-11-12T17:15:20.151-0500 [rsBackgroundSync] replSet syncing to: charlie-macbook-pro:31000 m31002| 2014-11-12T17:15:20.152-0500 [rsBackgroundSync] warning: Failed to connect to 127.0.0.1:31000, reason: errno:61 Connection refused m31002| 2014-11-12T17:15:20.152-0500 [rsBackgroundSync] repl: couldn't connect to server charlie-macbook-pro:31000 (127.0.0.1), connection attempt failed m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] shutdown: closing all files... m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] closeAllFiles() finished m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] journalCleanup... m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] removeJournalFiles m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] shutdown: removing fs lock... m31000| 2014-11-12T17:15:20.158-0500 [signalProcessingThread] dbexit: really exiting now m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] now exiting m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] dbexit: m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] shutdown: going to close listening sockets... m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] closing listening socket: 20 m31002| 2014-11-12T17:15:21.154-0500 [signalProcessingThread] closing listening socket: 21 m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] closing listening socket: 24 m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] removing socket file: /tmp/mongodb-31002.sock m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] shutdown: going to flush diaglog... m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] shutdown: going to close sockets... m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] shutdown: waiting for fs preallocator... m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] shutdown: lock for final commit... m31002| 2014-11-12T17:15:21.155-0500 [signalProcessingThread] shutdown: final commit... m31002| 2014-11-12T17:15:21.155-0500 [conn1] end connection 127.0.0.1:60173 (1 connection now open) m31002| 2014-11-12T17:15:21.163-0500 [signalProcessingThread] shutdown: closing all files... m31002| 2014-11-12T17:15:21.164-0500 [signalProcessingThread] closeAllFiles() finished m31002| 2014-11-12T17:15:21.164-0500 [signalProcessingThread] journalCleanup... m31002| 2014-11-12T17:15:21.164-0500 [signalProcessingThread] removeJournalFiles m31002| 2014-11-12T17:15:21.164-0500 [signalProcessingThread] shutdown: removing fs lock... m31002| 2014-11-12T17:15:21.164-0500 [signalProcessingThread] dbexit: really exiting now 2014-11-12T17:15:22.159-0500 I NETWORK [conn3] end connection 127.0.0.1:60163 (0 connections now open) 30.1973 seconds 2014-11-12T17:15:22.160-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60379 #4 (1 connection now open) 2014-11-12T17:15:22.160-0500 I CONTROL [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends 2014-11-12T17:15:22.160-0500 I NETWORK [conn4] end connection 127.0.0.1:60379 (0 connections now open) 2014-11-12T17:15:22.160-0500 I COMMANDS [signalProcessingThread] now exiting 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] closing listening socket: 6 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] closing listening socket: 7 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] closing listening socket: 11 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27999.sock 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2014-11-12T17:15:22.160-0500 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2014-11-12T17:15:22.160-0500 I STORAGE [signalProcessingThread] shutdown: waiting for fs preallocator... 2014-11-12T17:15:22.161-0500 I STORAGE [signalProcessingThread] shutdown: final commit... 2014-11-12T17:15:22.167-0500 I STORAGE [signalProcessingThread] shutdown: closing all files... 2014-11-12T17:15:22.167-0500 I STORAGE [signalProcessingThread] closeAllFiles() finished 2014-11-12T17:15:22.167-0500 I JOURNAL [signalProcessingThread] journalCleanup... 2014-11-12T17:15:22.167-0500 I JOURNAL [signalProcessingThread] removeJournalFiles 2014-11-12T17:15:22.167-0500 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2014-11-12T17:15:22.167-0500 I COMMANDS [signalProcessingThread] dbexit: rc: 0 1 tests succeeded