numInitialSyncListIndexesAttempts: ➜ dev.mongo git:(s25917) ✗ ./mongod --replSet testReplSet --setParameter enableTestCommands=1 --setParameter numInitialSyncAttempts=2 --dbpath /data/db1 2016-11-16T08:55:47.164-0500 I CONTROL [initandlisten] MongoDB starting : pid=77626 port=27017 dbpath=/data/db1 64-bit host=my-macbookpro.local 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] DEBUG build (which is slower) 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] db version v0.0.0 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] git version: none 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] allocator: system 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] modules: none 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] build environment: 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] distarch: x86_64 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] target_arch: x86_64 2016-11-16T08:55:47.166-0500 I CONTROL [initandlisten] options: { replication: { replSet: "testReplSet" }, setParameter: { enableTestCommands: "1", numInitialSyncAttempts: "2" }, storage: { dbPath: "/data/db1" } } 2016-11-16T08:55:47.168-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-11-16T08:55:47.586-0500 I CONTROL [initandlisten] 2016-11-16T08:55:47.586-0500 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-11-16T08:55:47.586-0500 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-11-16T08:55:47.586-0500 I CONTROL [initandlisten] 2016-11-16T08:55:47.734-0500 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db1/diagnostic.data' 2016-11-16T08:55:47.881-0500 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-11-16T08:55:47.882-0500 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2016-11-16T08:55:47.882-0500 I NETWORK [thread1] waiting for connections on port 27017 2016-11-16T08:55:48.965-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53134 #1 (1 connection now open) 2016-11-16T08:55:48.966-0500 I NETWORK [conn1] received client metadata from 192.168.2.228:53134 conn1: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T08:55:48.967-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T08:55:48.969-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T08:55:48.993-0500 I REPL [replExecDBWorker-0] Starting replication storage threads 2016-11-16T08:55:48.994-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 14, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T08:55:48.994-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T08:55:48.994-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T08:55:48.994-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20001 2016-11-16T08:55:48.995-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20000 is now in state PRIMARY 2016-11-16T08:55:48.996-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T08:55:48.996-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20001 is now in state SECONDARY 2016-11-16T08:55:49.046-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:50.945-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53142 #2 (2 connections now open) 2016-11-16T08:55:50.946-0500 I NETWORK [conn2] received client metadata from 192.168.2.228:53142 conn2: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T08:55:51.143-0500 I NETWORK [thread1] connection accepted from 127.0.0.1:53143 #3 (3 connections now open) 2016-11-16T08:55:51.144-0500 I NETWORK [conn3] received client metadata from 127.0.0.1:53143 conn3: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.0-rc2-80-gf946384" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T08:55:54.094-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T08:55:54.095-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T08:55:54.095-0500 I REPL [replication-0] ****** 2016-11-16T08:55:54.095-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T08:55:54.108-0500 I STORAGE [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-11-16T08:55:54.108-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T08:55:54.108-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T08:55:54.261-0500 I REPL [replication-0] ****** 2016-11-16T08:55:54.261-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T08:55:54.264-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T08:55:54.265-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T08:55:54.266-0500 I REPL [replication-0] Finished fetching oplog during initial sync: InvalidSyncSource: sync source my-macbookpro.local:20001 (last optime: { ts: Timestamp 0|0, t: -1 }; sync source index: -1; primary index: 0) is no longer valid. Last fetched optime and hash: { ts: Timestamp 1479304530000|1, t: 1 }[5976482192613142790] 2016-11-16T08:55:54.266-0500 E REPL [replication-0] Error fetching oplog during initial sync: InvalidSyncSource: sync source my-macbookpro.local:20001 (last optime: { ts: Timestamp 0|0, t: -1 }; sync source index: -1; primary index: 0) is no longer valid 2016-11-16T08:55:54.266-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T08:55:54.266-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:54.266-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 1 cause: InvalidSyncSource: sync source my-macbookpro.local:20001 (last optime: { ts: Timestamp 0|0, t: -1 }; sync source index: -1; primary index: 0) is no longer valid 2016-11-16T08:55:54.266-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T08:55:55.042-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53151 #4 (4 connections now open) 2016-11-16T08:55:55.042-0500 I - [conn4] end connection 192.168.2.228:53151 (4 connections now open) 2016-11-16T08:55:55.043-0500 I - [conn1] end connection 192.168.2.228:53134 (3 connections now open) 2016-11-16T08:55:55.045-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53154 #5 (3 connections now open) 2016-11-16T08:55:55.045-0500 I NETWORK [conn5] received client metadata from 192.168.2.228:53154 conn5: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T08:55:55.046-0500 I REPL [ReplicationExecutor] Cannot find self in new replica set configuration; I must be removed; NodeNotFound: No host described in new configuration 15 for replica set testReplSet maps to this node 2016-11-16T08:55:55.046-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 15, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T08:55:55.046-0500 I REPL [ReplicationExecutor] This node is not a member of the config 2016-11-16T08:55:55.046-0500 I REPL [ReplicationExecutor] transition to REMOVED 2016-11-16T08:55:55.046-0500 I NETWORK [ReplicationExecutor] legacy transport layer closing all connections 2016-11-16T08:55:55.046-0500 I NETWORK [ReplicationExecutor] Skip closing connection for connection # 5 2016-11-16T08:55:55.047-0500 I NETWORK [ReplicationExecutor] Skip closing connection for connection # 2 2016-11-16T08:55:55.047-0500 I - [conn3] end connection 127.0.0.1:53143 (3 connections now open) 2016-11-16T08:55:55.047-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53157 #6 (2 connections now open) 2016-11-16T08:55:55.047-0500 I - [conn6] end connection 192.168.2.228:53157 (3 connections now open) 2016-11-16T08:55:55.051-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 16, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T08:55:55.051-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T08:55:55.051-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T08:55:55.051-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T08:55:55.053-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T08:55:55.270-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:55.270-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:55.311-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T08:55:55.320-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T08:55:55.320-0500 I REPL [replication-0] ****** 2016-11-16T08:55:55.320-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T08:55:55.332-0500 I STORAGE [replication-0] WiredTigerRecordStoreThread local.oplog.rs already started 2016-11-16T08:55:55.332-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T08:55:55.332-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T08:55:55.388-0500 I REPL [replication-0] ****** 2016-11-16T08:55:55.390-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T08:55:55.392-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T08:55:55.393-0500 I REPL [replication-0] CollectionCloner::start called, on ns:admin.system.version 2016-11-16T08:55:55.393-0500 W REPL [replication-0] collection clone for 'admin.system.version' failed due to IllegalOperation: While cloning collection 'admin.system.version' there was an error 'fetcher already scheduled' 2016-11-16T08:55:55.393-0500 W REPL [replication-0] database 'admin' (1 of 1) clone failed due to InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T08:55:55.393-0500 I REPL [replication-0] data clone finished, status: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T08:55:55.393-0500 E REPL [replication-0] Failed to clone data due to 'InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001' 2016-11-16T08:55:55.393-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T08:55:55.394-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479304555000|1, t: 1 }[-3744350103768624467] 2016-11-16T08:55:55.394-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:55.394-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 0 cause: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T08:55:55.394-0500 F REPL [initial sync-0] The maximum number of retries have been exhausted for initial sync. 2016-11-16T08:55:55.394-0500 I REPL [initial sync-0] Initial Sync Statistics: { failedInitialSyncAttempts: 2, maxFailedInitialSyncAttempts: 2, initialSyncStart: new Date(1479304548994), initialSyncEnd: new Date(1479304555394), initialSyncElapsedMillis: 6400, initialSyncAttempts: [ { durationMillis: 1, status: "InvalidSyncSource: sync source my-macbookpro.local:20001 (last optime: { ts: Timestamp 0|0, t: -1 }; sync source index: -1; primary index: 0) is no lo...", syncSource: "my-macbookpro.local:20001" }, { durationMillis: 4, status: "InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001", syncSource: "my-macbookpro.local:20001" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp 1479304555000|1 } 2016-11-16T08:55:55.394-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T08:55:55.394-0500 I - [initial sync-0] Fatal assertion 40088 InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 at src/mongo/db/repl/replication_coordinator_impl.cpp 619 2016-11-16T08:55:55.394-0500 I - [initial sync-0] ***aborting after fassert() failure numInitialSyncCollectionFindAttempts: ➜ dev.mongo git:(s25917) ✗ ./mongod --replSet testReplSet --setParameter enableTestCommands=1 --setParameter numInitialSyncAttempts=2 --dbpath /data/db1 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] MongoDB starting : pid=77772 port=27017 dbpath=/data/db1 64-bit host=my-macbookpro.local 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] DEBUG build (which is slower) 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] db version v0.0.0 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] git version: none 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] allocator: system 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] modules: none 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] build environment: 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] distarch: x86_64 2016-11-16T09:04:09.444-0500 I CONTROL [initandlisten] target_arch: x86_64 2016-11-16T09:04:09.445-0500 I CONTROL [initandlisten] options: { replication: { replSet: "testReplSet" }, setParameter: { enableTestCommands: "1", numInitialSyncAttempts: "2" }, storage: { dbPath: "/data/db1" } } 2016-11-16T09:04:09.445-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-11-16T09:04:09.901-0500 I CONTROL [initandlisten] 2016-11-16T09:04:09.901-0500 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-11-16T09:04:09.901-0500 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-11-16T09:04:09.901-0500 I CONTROL [initandlisten] 2016-11-16T09:04:10.035-0500 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db1/diagnostic.data' 2016-11-16T09:04:10.150-0500 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-11-16T09:04:10.150-0500 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2016-11-16T09:04:10.150-0500 I NETWORK [thread1] waiting for connections on port 27017 2016-11-16T09:04:12.689-0500 I NETWORK [thread1] connection accepted from 127.0.0.1:53340 #1 (1 connection now open) 2016-11-16T09:04:12.690-0500 I NETWORK [conn1] received client metadata from 127.0.0.1:53340 conn1: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.0-rc2-80-gf946384" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:04:16.156-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53342 #2 (2 connections now open) 2016-11-16T09:04:16.156-0500 I - [conn2] end connection 192.168.2.228:53342 (2 connections now open) 2016-11-16T09:04:16.157-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53344 #3 (2 connections now open) 2016-11-16T09:04:16.158-0500 I NETWORK [conn3] received client metadata from 192.168.2.228:53344 conn3: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:04:16.159-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T09:04:16.161-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T09:04:16.161-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53348 #4 (3 connections now open) 2016-11-16T09:04:16.161-0500 I - [conn4] end connection 192.168.2.228:53348 (3 connections now open) 2016-11-16T09:04:16.163-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:53352 #5 (3 connections now open) 2016-11-16T09:04:16.163-0500 I NETWORK [conn5] received client metadata from 192.168.2.228:53352 conn5: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:04:16.164-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:04:16.165-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:04:16.186-0500 I REPL [replExecDBWorker-1] Starting replication storage threads 2016-11-16T09:04:16.187-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 22, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:04:16.187-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T09:04:16.187-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T09:04:16.188-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20000 is now in state PRIMARY 2016-11-16T09:04:16.188-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20001 is now in state SECONDARY 2016-11-16T09:04:16.244-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:16.276-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:04:16.276-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:04:16.276-0500 I REPL [replication-0] ****** 2016-11-16T09:04:16.276-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:04:16.287-0500 I STORAGE [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-11-16T09:04:16.287-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:04:16.287-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:04:16.381-0500 I REPL [replication-0] ****** 2016-11-16T09:04:16.381-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:04:16.383-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:04:16.384-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:04:16.385-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:04:16.386-0500 I REPL [replication-0] CollectionCloner::start called, on ns:admin.system.version 2016-11-16T09:04:16.411-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 2, key: { version: 1 }, name: "incompatible_with_version_32", ns: "admin.system.version" } 2016-11-16T09:04:16.411-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:04:16.424-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2016-11-16T09:04:16.424-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:04:16.437-0500 W REPL [repl writer worker 0] collection clone for 'admin.system.version' failed due to IllegalOperation: While cloning collection 'admin.system.version' there was an error 'fetcher already scheduled' 2016-11-16T09:04:16.437-0500 W REPL [repl writer worker 0] database 'admin' (1 of 2) clone failed due to InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:16.437-0500 I REPL [repl writer worker 0] data clone finished, status: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:16.437-0500 E REPL [repl writer worker 0] Failed to clone data due to 'InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001' 2016-11-16T09:04:16.437-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:04:16.438-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305040000|1, t: 1 }[2059269450974023811] 2016-11-16T09:04:16.438-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:16.438-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 1 cause: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:17.439-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:17.439-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:17.474-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:04:17.482-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 2 2016-11-16T09:04:17.487-0500 I REPL [replication-0] ****** 2016-11-16T09:04:17.487-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:04:17.497-0500 I STORAGE [replication-0] WiredTigerRecordStoreThread local.oplog.rs already started 2016-11-16T09:04:17.497-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:04:17.497-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:04:17.546-0500 I REPL [replication-0] ****** 2016-11-16T09:04:17.547-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:04:17.549-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:04:17.549-0500 I REPL [replication-0] CollectionCloner::start called, on ns:admin.system.version 2016-11-16T09:04:17.572-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 2, key: { version: 1 }, name: "incompatible_with_version_32", ns: "admin.system.version" } 2016-11-16T09:04:17.572-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:04:17.584-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2016-11-16T09:04:17.584-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:04:17.596-0500 W REPL [repl writer worker 1] collection clone for 'admin.system.version' failed due to IllegalOperation: While cloning collection 'admin.system.version' there was an error 'fetcher already scheduled' 2016-11-16T09:04:17.596-0500 W REPL [repl writer worker 1] database 'admin' (1 of 2) clone failed due to InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:17.596-0500 I REPL [repl writer worker 1] data clone finished, status: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:17.596-0500 E REPL [repl writer worker 1] Failed to clone data due to 'InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001' 2016-11-16T09:04:17.596-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:04:17.596-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305056000|1, t: 1 }[-417710363488071505] 2016-11-16T09:04:17.596-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:17.596-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 0 cause: InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 2016-11-16T09:04:17.596-0500 F REPL [initial sync-0] The maximum number of retries have been exhausted for initial sync. 2016-11-16T09:04:17.597-0500 I REPL [initial sync-0] Initial Sync Statistics: { failedInitialSyncAttempts: 2, maxFailedInitialSyncAttempts: 2, initialSyncStart: new Date(1479305056187), initialSyncEnd: new Date(1479305057596), initialSyncElapsedMillis: 1409, initialSyncAttempts: [ { durationMillis: 54, status: "InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001", syncSource: "my-macbookpro.local:20001" }, { durationMillis: 49, status: "InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001", syncSource: "my-macbookpro.local:20001" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp 1479305056000|1 } 2016-11-16T09:04:17.597-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:04:17.597-0500 I - [initial sync-0] Fatal assertion 40088 InitialSyncFailure: Failed to clone 1 collection(s) in 'admin' from my-macbookpro.local:20001 at src/mongo/db/repl/replication_coordinator_impl.cpp 619 2016-11-16T09:04:17.597-0500 I - [initial sync-0] ***aborting after fassert() failure numInitialSyncOplogFindAttempts: ➜ dev.mongo git:(s25917) ✗ ./mongod --replSet testReplSet --setParameter enableTestCommands=1 --setParameter numInitialSyncAttempts=2 --dbpath /data/db1 2016-11-16T09:10:32.175-0500 I CONTROL [initandlisten] MongoDB starting : pid=77867 port=27017 dbpath=/data/db1 64-bit host=my-macbookpro.local 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] DEBUG build (which is slower) 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] db version v0.0.0 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] git version: none 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] allocator: system 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] modules: none 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] build environment: 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] distarch: x86_64 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] target_arch: x86_64 2016-11-16T09:10:32.176-0500 I CONTROL [initandlisten] options: { replication: { replSet: "testReplSet" }, setParameter: { enableTestCommands: "1", numInitialSyncAttempts: "2" }, storage: { dbPath: "/data/db1" } } 2016-11-16T09:10:32.177-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-11-16T09:10:32.621-0500 I CONTROL [initandlisten] 2016-11-16T09:10:32.621-0500 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-11-16T09:10:32.621-0500 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-11-16T09:10:32.621-0500 I CONTROL [initandlisten] 2016-11-16T09:10:32.773-0500 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db1/diagnostic.data' 2016-11-16T09:10:32.877-0500 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-11-16T09:10:32.877-0500 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2016-11-16T09:10:32.878-0500 I NETWORK [thread1] waiting for connections on port 27017 2016-11-16T09:10:35.680-0500 I NETWORK [thread1] connection accepted from 127.0.0.1:54199 #1 (1 connection now open) 2016-11-16T09:10:35.681-0500 I NETWORK [conn1] received client metadata from 127.0.0.1:54199 conn1: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.0-rc2-80-gf946384" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:10:38.931-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54201 #2 (2 connections now open) 2016-11-16T09:10:38.931-0500 I - [conn2] end connection 192.168.2.228:54201 (2 connections now open) 2016-11-16T09:10:38.932-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54203 #3 (2 connections now open) 2016-11-16T09:10:38.933-0500 I NETWORK [conn3] received client metadata from 192.168.2.228:54203 conn3: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:10:38.934-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T09:10:38.934-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54205 #4 (3 connections now open) 2016-11-16T09:10:38.935-0500 I NETWORK [conn4] received client metadata from 192.168.2.228:54205 conn4: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:10:38.936-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T09:10:38.936-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54209 #5 (4 connections now open) 2016-11-16T09:10:38.936-0500 I - [conn5] end connection 192.168.2.228:54209 (4 connections now open) 2016-11-16T09:10:38.938-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54213 #6 (4 connections now open) 2016-11-16T09:10:38.938-0500 I NETWORK [conn6] received client metadata from 192.168.2.228:54213 conn6: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:10:38.939-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:10:38.940-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:10:38.966-0500 I REPL [replExecDBWorker-0] Starting replication storage threads 2016-11-16T09:10:38.967-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 30, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:10:38.967-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T09:10:38.967-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T09:10:38.968-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20000 is now in state PRIMARY 2016-11-16T09:10:38.968-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20001 is now in state SECONDARY 2016-11-16T09:10:39.024-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:39.054-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:10:39.055-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:10:39.055-0500 I REPL [replication-0] ****** 2016-11-16T09:10:39.055-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:10:39.067-0500 I STORAGE [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-11-16T09:10:39.067-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:10:39.067-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:10:39.166-0500 I REPL [replication-0] ****** 2016-11-16T09:10:39.166-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:10:39.168-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:10:39.169-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:10:39.171-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:10:39.171-0500 I REPL [replication-0] CollectionCloner::start called, on ns:admin.system.version 2016-11-16T09:10:39.197-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 2, key: { version: 1 }, name: "incompatible_with_version_32", ns: "admin.system.version" } 2016-11-16T09:10:39.197-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:39.210-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2016-11-16T09:10:39.210-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:39.211-0500 I COMMAND [InitialSyncInserters-admin.system.version0] setting featureCompatibilityVersion to 3.4 2016-11-16T09:10:39.228-0500 I REPL [replication-0] CollectionCloner::start called, on ns:test.test 2016-11-16T09:10:39.255-0500 I INDEX [InitialSyncInserters-test.test0] build index on: test.test properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "test.test" } 2016-11-16T09:10:39.255-0500 I INDEX [InitialSyncInserters-test.test0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:39.266-0500 I REPL [repl writer worker 3] data clone finished, status: OK 2016-11-16T09:10:39.266-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:10:39.266-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305428000|1, t: 1 }[-3479195526004026737] 2016-11-16T09:10:39.266-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:39.266-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 1 cause: IllegalOperation: fetcher already scheduled 2016-11-16T09:10:40.270-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:40.270-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:40.303-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:10:40.311-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 3 2016-11-16T09:10:40.343-0500 I REPL [replication-0] ****** 2016-11-16T09:10:40.343-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:10:40.354-0500 I STORAGE [replication-0] WiredTigerRecordStoreThread local.oplog.rs already started 2016-11-16T09:10:40.354-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:10:40.354-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:10:40.397-0500 I REPL [replication-0] ****** 2016-11-16T09:10:40.398-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:10:40.400-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:10:40.401-0500 I REPL [replication-0] CollectionCloner::start called, on ns:admin.system.version 2016-11-16T09:10:40.426-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 2, key: { version: 1 }, name: "incompatible_with_version_32", ns: "admin.system.version" } 2016-11-16T09:10:40.426-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:40.438-0500 I INDEX [InitialSyncInserters-admin.system.version0] build index on: admin.system.version properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2016-11-16T09:10:40.438-0500 I INDEX [InitialSyncInserters-admin.system.version0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:40.439-0500 I COMMAND [InitialSyncInserters-admin.system.version0] setting featureCompatibilityVersion to 3.4 2016-11-16T09:10:40.450-0500 I REPL [replication-0] CollectionCloner::start called, on ns:test.test 2016-11-16T09:10:40.474-0500 I INDEX [InitialSyncInserters-test.test0] build index on: test.test properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "test.test" } 2016-11-16T09:10:40.474-0500 I INDEX [InitialSyncInserters-test.test0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2016-11-16T09:10:40.485-0500 I REPL [repl writer worker 6] data clone finished, status: OK 2016-11-16T09:10:40.485-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:10:40.485-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305438000|1, t: 1 }[2480989358431303902] 2016-11-16T09:10:40.485-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:40.486-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 0 cause: IllegalOperation: fetcher already scheduled 2016-11-16T09:10:40.486-0500 F REPL [initial sync-0] The maximum number of retries have been exhausted for initial sync. 2016-11-16T09:10:40.486-0500 I REPL [initial sync-0] Initial Sync Statistics: { failedInitialSyncAttempts: 2, maxFailedInitialSyncAttempts: 2, initialSyncStart: new Date(1479305438967), initialSyncEnd: new Date(1479305440486), initialSyncElapsedMillis: 1519, initialSyncAttempts: [ { durationMillis: 97, status: "IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" }, { durationMillis: 87, status: "IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp 1479305438000|1 } 2016-11-16T09:10:40.486-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:10:40.486-0500 I - [initial sync-0] Fatal assertion 40088 IllegalOperation: fetcher already scheduled at src/mongo/db/repl/replication_coordinator_impl.cpp 619 2016-11-16T09:10:40.486-0500 I - [initial sync-0] ***aborting after fassert() failure numInitialSyncListDatabasesAttempts: ➜ dev.mongo git:(s25917) ✗ rm -rf /data/db1; mkdir /data/db1; ./mongod --replSet testReplSet --setParameter enableTestCommands=1 --setParameter numInitialSyncAttempts=2 --dbpath /data/db1 2016-11-16T09:11:50.395-0500 I CONTROL [initandlisten] MongoDB starting : pid=77889 port=27017 dbpath=/data/db1 64-bit host=my-macbookpro.local 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] DEBUG build (which is slower) 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] db version v0.0.0 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] git version: none 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] allocator: system 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] modules: none 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] build environment: 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] distarch: x86_64 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] target_arch: x86_64 2016-11-16T09:11:50.396-0500 I CONTROL [initandlisten] options: { replication: { replSet: "testReplSet" }, setParameter: { enableTestCommands: "1", numInitialSyncAttempts: "2" }, storage: { dbPath: "/data/db1" } } 2016-11-16T09:11:50.397-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-11-16T09:11:50.823-0500 I CONTROL [initandlisten] 2016-11-16T09:11:50.823-0500 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-11-16T09:11:50.823-0500 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-11-16T09:11:50.823-0500 I CONTROL [initandlisten] 2016-11-16T09:11:51.017-0500 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db1/diagnostic.data' 2016-11-16T09:11:51.125-0500 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-11-16T09:11:51.125-0500 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2016-11-16T09:11:51.125-0500 I NETWORK [thread1] waiting for connections on port 27017 2016-11-16T09:11:51.136-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54639 #1 (1 connection now open) 2016-11-16T09:11:51.137-0500 I NETWORK [conn1] received client metadata from 192.168.2.228:54639 conn1: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:11:51.138-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:11:51.141-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:11:51.166-0500 I REPL [replExecDBWorker-0] Starting replication storage threads 2016-11-16T09:11:51.167-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 30, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:11:51.167-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T09:11:51.167-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T09:11:51.167-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T09:11:51.167-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20001 is now in state SECONDARY 2016-11-16T09:11:51.168-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T09:11:51.169-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20000 is now in state PRIMARY 2016-11-16T09:11:51.170-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54647 #2 (2 connections now open) 2016-11-16T09:11:51.170-0500 I NETWORK [conn2] received client metadata from 192.168.2.228:54647 conn2: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:11:51.220-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:54.200-0500 I NETWORK [thread1] connection accepted from 127.0.0.1:54650 #3 (3 connections now open) 2016-11-16T09:11:54.200-0500 I NETWORK [conn3] received client metadata from 127.0.0.1:54650 conn3: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.0-rc2-80-gf946384" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:11:56.174-0500 I REPL [ReplicationExecutor] Cannot find self in new replica set configuration; I must be removed; NodeNotFound: No host described in new configuration 31 for replica set testReplSet maps to this node 2016-11-16T09:11:56.174-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 31, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:11:56.174-0500 I REPL [ReplicationExecutor] This node is not a member of the config 2016-11-16T09:11:56.174-0500 I REPL [ReplicationExecutor] transition to REMOVED 2016-11-16T09:11:56.174-0500 I NETWORK [ReplicationExecutor] legacy transport layer closing all connections 2016-11-16T09:11:56.174-0500 I NETWORK [ReplicationExecutor] Skip closing connection for connection # 2 2016-11-16T09:11:56.174-0500 I NETWORK [ReplicationExecutor] Skip closing connection for connection # 1 2016-11-16T09:11:56.174-0500 I - [conn3] end connection 127.0.0.1:54650 (3 connections now open) 2016-11-16T09:11:56.659-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54654 #4 (2 connections now open) 2016-11-16T09:11:56.659-0500 I - [conn4] end connection 192.168.2.228:54654 (3 connections now open) 2016-11-16T09:11:56.664-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:54656 #5 (2 connections now open) 2016-11-16T09:11:56.664-0500 I - [conn5] end connection 192.168.2.228:54656 (3 connections now open) 2016-11-16T09:11:56.668-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 32, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:11:56.668-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T09:11:56.668-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T09:11:57.268-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:11:57.269-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:11:57.269-0500 I REPL [replication-0] ****** 2016-11-16T09:11:57.269-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:11:57.283-0500 I STORAGE [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-11-16T09:11:57.283-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:11:57.284-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:11:57.376-0500 I REPL [replication-0] ****** 2016-11-16T09:11:57.377-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:11:57.378-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:11:57.380-0500 I REPL [initial sync-0] data clone finished, status: IllegalOperation: fetcher already scheduled 2016-11-16T09:11:57.380-0500 E REPL [initial sync-0] Failed to clone data due to 'IllegalOperation: fetcher already scheduled' 2016-11-16T09:11:57.380-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:11:57.380-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305516000|1, t: 1 }[6991196769664772125] 2016-11-16T09:11:57.380-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:57.380-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 1 cause: IllegalOperation: fetcher already scheduled 2016-11-16T09:11:58.380-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:58.380-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:58.416-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:11:58.423-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:11:58.423-0500 I REPL [replication-0] ****** 2016-11-16T09:11:58.423-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:11:58.433-0500 I STORAGE [replication-0] WiredTigerRecordStoreThread local.oplog.rs already started 2016-11-16T09:11:58.433-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:11:58.433-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:11:58.475-0500 I REPL [replication-0] ****** 2016-11-16T09:11:58.476-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:11:58.479-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:11:58.481-0500 I REPL [initial sync-0] data clone finished, status: IllegalOperation: fetcher already scheduled 2016-11-16T09:11:58.481-0500 E REPL [initial sync-0] Failed to clone data due to 'IllegalOperation: fetcher already scheduled' 2016-11-16T09:11:58.481-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:11:58.481-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305516000|1, t: 1 }[6991196769664772125] 2016-11-16T09:11:58.481-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:58.481-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 0 cause: IllegalOperation: fetcher already scheduled 2016-11-16T09:11:58.481-0500 F REPL [initial sync-0] The maximum number of retries have been exhausted for initial sync. 2016-11-16T09:11:58.481-0500 I REPL [initial sync-0] Initial Sync Statistics: { failedInitialSyncAttempts: 2, maxFailedInitialSyncAttempts: 2, initialSyncStart: new Date(1479305511167), initialSyncEnd: new Date(1479305518481), initialSyncElapsedMillis: 7314, initialSyncAttempts: [ { durationMillis: 0, status: "IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" }, { durationMillis: 0, status: "IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp 1479305516000|1 } 2016-11-16T09:11:58.481-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:11:58.481-0500 I - [initial sync-0] Fatal assertion 40088 IllegalOperation: fetcher already scheduled at src/mongo/db/repl/replication_coordinator_impl.cpp 619 2016-11-16T09:11:58.481-0500 I - [initial sync-0] ***aborting after fassert() failure numInitialSyncListCollectionsAttempts: ➜ dev.mongo git:(s25917) ✗ rm -rf /data/db1; mkdir /data/db1; ./mongod --replSet testReplSet --setParameter enableTestCommands=1 --setParameter numInitialSyncAttempts=2 --dbpath /data/db1 2016-11-16T09:14:09.903-0500 I CONTROL [initandlisten] MongoDB starting : pid=77925 port=27017 dbpath=/data/db1 64-bit host=my-macbookpro.local 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] DEBUG build (which is slower) 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] db version v0.0.0 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] git version: none 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] allocator: system 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] modules: none 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] build environment: 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] distarch: x86_64 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] target_arch: x86_64 2016-11-16T09:14:09.904-0500 I CONTROL [initandlisten] options: { replication: { replSet: "testReplSet" }, setParameter: { enableTestCommands: "1", numInitialSyncAttempts: "2" }, storage: { dbPath: "/data/db1" } } 2016-11-16T09:14:09.905-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-11-16T09:14:10.389-0500 I CONTROL [initandlisten] 2016-11-16T09:14:10.389-0500 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-11-16T09:14:10.389-0500 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-11-16T09:14:10.389-0500 I CONTROL [initandlisten] 2016-11-16T09:14:10.507-0500 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db1/diagnostic.data' 2016-11-16T09:14:10.624-0500 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-11-16T09:14:10.624-0500 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2016-11-16T09:14:10.624-0500 I NETWORK [thread1] waiting for connections on port 27017 2016-11-16T09:14:12.308-0500 I NETWORK [thread1] connection accepted from 127.0.0.1:55354 #1 (1 connection now open) 2016-11-16T09:14:12.309-0500 I NETWORK [conn1] received client metadata from 127.0.0.1:55354 conn1: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.0-rc2-80-gf946384" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:14:14.495-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:55356 #2 (2 connections now open) 2016-11-16T09:14:14.496-0500 I - [conn2] end connection 192.168.2.228:55356 (2 connections now open) 2016-11-16T09:14:14.497-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:55358 #3 (2 connections now open) 2016-11-16T09:14:14.497-0500 I NETWORK [conn3] received client metadata from 192.168.2.228:55358 conn3: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:14:14.498-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20000 2016-11-16T09:14:14.498-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:55360 #4 (3 connections now open) 2016-11-16T09:14:14.499-0500 I NETWORK [conn4] received client metadata from 192.168.2.228:55360 conn4: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:14:14.500-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20000 2016-11-16T09:14:14.500-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:55364 #5 (4 connections now open) 2016-11-16T09:14:14.500-0500 I - [conn5] end connection 192.168.2.228:55364 (4 connections now open) 2016-11-16T09:14:14.502-0500 I NETWORK [thread1] connection accepted from 192.168.2.228:55368 #6 (4 connections now open) 2016-11-16T09:14:14.502-0500 I NETWORK [conn6] received client metadata from 192.168.2.228:55368 conn6: { driver: { name: "NetworkInterfaceASIO-Replication", version: "0.0.0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "16.1.0" } } 2016-11-16T09:14:14.503-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:14:14.504-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:14:14.524-0500 I REPL [replExecDBWorker-0] Starting replication storage threads 2016-11-16T09:14:14.524-0500 I REPL [ReplicationExecutor] New replica set config in use: { _id: "testReplSet", version: 36, protocolVersion: 1, members: [ { _id: 0, host: "my-macbookpro.local:20000", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "my-macbookpro.local:20001", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "my-macbookpro.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: 2000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('582c6073eb0396f980e5f7ff') } } 2016-11-16T09:14:14.524-0500 I REPL [ReplicationExecutor] This node is my-macbookpro.local:27017 in the config 2016-11-16T09:14:14.524-0500 I REPL [ReplicationExecutor] transition to STARTUP2 2016-11-16T09:14:14.525-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20000 is now in state PRIMARY 2016-11-16T09:14:14.526-0500 I REPL [ReplicationExecutor] Member my-macbookpro.local:20001 is now in state SECONDARY 2016-11-16T09:14:14.577-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:14.613-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:14:14.613-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:14:14.614-0500 I REPL [replication-0] ****** 2016-11-16T09:14:14.614-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:14:14.627-0500 I STORAGE [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-11-16T09:14:14.627-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:14:14.627-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:14:14.722-0500 I REPL [replication-0] ****** 2016-11-16T09:14:14.723-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:14:14.724-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:14:14.725-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:14:14.726-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:14:14.727-0500 E REPL [replication-0] Error scheduling listCollections for database: admin, error:IllegalOperation: fetcher already scheduled 2016-11-16T09:14:14.727-0500 E REPL [replication-0] could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:14.727-0500 I REPL [replication-0] data clone finished, status: InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:14.727-0500 E REPL [replication-0] Failed to clone data due to 'InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled' 2016-11-16T09:14:14.727-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:14:14.727-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305644000|1, t: 1 }[7317426872193946146] 2016-11-16T09:14:14.727-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:14.727-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 1 cause: InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:15.732-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:15.732-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:15.763-0500 I REPL [initial sync-0] sync source candidate: my-macbookpro.local:20001 2016-11-16T09:14:15.771-0500 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2016-11-16T09:14:15.771-0500 I REPL [replication-0] ****** 2016-11-16T09:14:15.771-0500 I REPL [replication-0] creating replication oplog of size: 192MB... 2016-11-16T09:14:15.780-0500 I STORAGE [replication-0] WiredTigerRecordStoreThread local.oplog.rs already started 2016-11-16T09:14:15.780-0500 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2016-11-16T09:14:15.780-0500 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2016-11-16T09:14:15.820-0500 I REPL [replication-0] ****** 2016-11-16T09:14:15.821-0500 I ASIO [NetworkInterfaceASIO-RS-0] Connecting to my-macbookpro.local:20001 2016-11-16T09:14:15.823-0500 E REPL [replication-0] Error scheduling listCollections for database: admin, error:IllegalOperation: fetcher already scheduled 2016-11-16T09:14:15.823-0500 E REPL [replication-0] could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:15.823-0500 I REPL [replication-0] data clone finished, status: InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:15.823-0500 E REPL [replication-0] Failed to clone data due to 'InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled' 2016-11-16T09:14:15.823-0500 I REPL [initial sync-0] Initial sync attempt finishing up. 2016-11-16T09:14:15.823-0500 I ASIO [NetworkInterfaceASIO-RS-0] Successfully connected to my-macbookpro.local:20001 2016-11-16T09:14:15.823-0500 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: Callback canceled. Last fetched optime and hash: { ts: Timestamp 1479305654000|1, t: 1 }[8717009216440354860] 2016-11-16T09:14:15.823-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:15.823-0500 E REPL [initial sync-0] Initial sync attempt failed -- attempts left: 0 cause: InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled 2016-11-16T09:14:15.823-0500 F REPL [initial sync-0] The maximum number of retries have been exhausted for initial sync. 2016-11-16T09:14:15.824-0500 I REPL [initial sync-0] Initial Sync Statistics: { failedInitialSyncAttempts: 2, maxFailedInitialSyncAttempts: 2, initialSyncStart: new Date(1479305654524), initialSyncEnd: new Date(1479305655823), initialSyncElapsedMillis: 1299, initialSyncAttempts: [ { durationMillis: 2, status: "InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" }, { durationMillis: 2, status: "InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled", syncSource: "my-macbookpro.local:20001" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp 1479305654000|1 } 2016-11-16T09:14:15.824-0500 I REPL [initial sync-0] DataReplicator::_anyActiveHandles_inlock returned false as nothing is active. 2016-11-16T09:14:15.824-0500 I - [initial sync-0] Fatal assertion 40088 InitialSyncFailure: could not create cloner for database: admin due to: IllegalOperation: fetcher already scheduled at src/mongo/db/repl/replication_coordinator_impl.cpp 619 2016-11-16T09:14:15.824-0500 I - [initial sync-0] ***aborting after fassert() failure