2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] MongoDB starting : pid=53056 port=27017 dbpath=/home/ec2-user/mongo/data 64-bit host=ip-172-31-40-189
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] db version v3.6.0-rc4-41-ge608b8b349
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] git version: e608b8b3490ac7a1bbb717411d6499c2d45b21f6
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] modules: none
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] build environment:
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten]     distarch: x86_64
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2017-11-18T17:48:01.798+0000 I CONTROL  [initandlisten] options: { net: { bindIp: "172.31.40.189", serviceExecutor: "adaptive", transportLayer: "asio" }, processManagement: { fork: true }, replication: { replSet: "rs" }, storage: { dbPath: "data" }, systemLog: { destination: "file", path: "mongod.log" } }
2017-11-18T17:48:01.798+0000 I STORAGE  [initandlisten] 
2017-11-18T17:48:01.798+0000 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2017-11-18T17:48:01.798+0000 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2017-11-18T17:48:01.798+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=31695M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] 
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] 
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] 
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2017-11-18T17:48:01.844+0000 I CONTROL  [initandlisten] 
2017-11-18T17:48:01.846+0000 I STORAGE  [initandlisten] createCollection: local.startup_log with no UUID.
2017-11-18T17:48:01.856+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/home/ec2-user/mongo/data/diagnostic.data'
2017-11-18T17:48:01.856+0000 I STORAGE  [initandlisten] createCollection: local.me with no UUID.
2017-11-18T17:48:01.867+0000 I STORAGE  [initandlisten] createCollection: local.replset.minvalid with no UUID.
2017-11-18T17:48:01.877+0000 I REPL     [initandlisten] Did not find local voted for document at startup.
2017-11-18T17:48:01.877+0000 I REPL     [initandlisten] Did not find local Rollback ID document at startup. Creating one.
2017-11-18T17:48:01.877+0000 I STORAGE  [initandlisten] createCollection: local.system.rollback.id with no UUID.
2017-11-18T17:48:01.887+0000 I REPL     [initandlisten] Did not find local replica set configuration document at startup;  NoMatchingDocument: Did not find replica set configuration document in local.system.replset
2017-11-18T17:48:01.888+0000 I EXECUTOR [initandlisten] No thread count configured for executor. Using number of cores / 2: 8
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-1] Started new database worker thread 1
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-2] Started new database worker thread 2
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-3] Started new database worker thread 3
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-4] Started new database worker thread 4
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-7] Started new database worker thread 7
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-6] Started new database worker thread 6
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-5] Started new database worker thread 5
2017-11-18T17:48:01.888+0000 I EXECUTOR [worker-8] Started new database worker thread 8
2017-11-18T17:48:01.888+0000 I NETWORK  [initandlisten] waiting for connections on port 27017
2017-11-18T17:48:10.173+0000 I NETWORK  [listener] connection accepted from 172.31.34.92:34904 #1 (1 connection now open)
2017-11-18T17:48:10.173+0000 I NETWORK  [worker-1] end connection 172.31.34.92:34904 (0 connections now open)
2017-11-18T17:48:10.175+0000 I NETWORK  [listener] connection accepted from 172.31.34.92:34908 #2 (1 connection now open)
2017-11-18T17:48:10.175+0000 I NETWORK  [conn2] received client metadata from 172.31.34.92:34908 conn: { driver: { name: "NetworkInterfaceASIO-Replication", version: "3.6.0-rc4-41-ge608b8b349" }, os: { type: "Linux", name: "SUSE Linux Enterprise Server 12 (x86_64)", architecture: "x86_64", version: "Kernel 4.4.92-6.18-default" } }
2017-11-18T17:48:10.175+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T17:48:10.177+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.92:27017, took 2ms (1 connections now open to 172.31.34.92:27017)
2017-11-18T17:48:12.178+0000 I NETWORK  [listener] connection accepted from 172.31.34.57:47768 #3 (2 connections now open)
2017-11-18T17:48:12.179+0000 I NETWORK  [worker-8] end connection 172.31.34.57:47768 (1 connection now open)
2017-11-18T17:48:12.179+0000 I STORAGE  [replexec-0] createCollection: local.system.replset with no UUID.
2017-11-18T17:48:12.190+0000 I REPL     [replexec-0] New replica set config in use: { _id: "rs", version: 1, protocolVersion: 1, members: [ { _id: 0, host: "172.31.34.92:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "172.31.40.189:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "172.31.34.57:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: false, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('5a10725927866429bc6c2c44') } }
2017-11-18T17:48:12.190+0000 I REPL     [replexec-0] This node is 172.31.40.189:27017 in the config
2017-11-18T17:48:12.190+0000 I REPL     [replexec-0] transition to STARTUP2 from STARTUP
2017-11-18T17:48:12.190+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.57:27017
2017-11-18T17:48:12.190+0000 I REPL     [replexec-0] Starting replication storage threads
2017-11-18T17:48:12.191+0000 I REPL     [replexec-3] Member 172.31.34.92:27017 is now in state SECONDARY
2017-11-18T17:48:12.191+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.57:27017, took 1ms (1 connections now open to 172.31.34.57:27017)
2017-11-18T17:48:12.191+0000 I REPL     [replexec-1] Member 172.31.34.57:27017 is now in state STARTUP2
2017-11-18T17:48:12.191+0000 I NETWORK  [listener] connection accepted from 172.31.34.57:47770 #4 (2 connections now open)
2017-11-18T17:48:12.191+0000 I NETWORK  [conn4] received client metadata from 172.31.34.57:47770 conn: { driver: { name: "NetworkInterfaceASIO-Replication", version: "3.6.0-rc4-41-ge608b8b349" }, os: { type: "Linux", name: "SUSE Linux Enterprise Server 12 (x86_64)", architecture: "x86_64", version: "Kernel 4.4.92-6.18-default" } }
2017-11-18T17:48:12.191+0000 I STORAGE  [replexec-0] createCollection: local.temp_oplog_buffer with no UUID.
2017-11-18T17:48:12.201+0000 I REPL     [replication-0] Starting initial sync (attempt 1 of 10)
2017-11-18T17:48:12.201+0000 I STORAGE  [replication-0] Finishing collection drop for local.temp_oplog_buffer (no UUID).
2017-11-18T17:48:12.204+0000 I STORAGE  [replication-0] createCollection: local.temp_oplog_buffer with no UUID.
2017-11-18T17:48:21.034+0000 I STORAGE  [conn2] createCollection: local.replset.election with no UUID.
2017-11-18T17:48:21.216+0000 I REPL     [replication-1] Initial sync attempt finishing up.
2017-11-18T17:48:21.216+0000 I REPL     [replication-1] Initial Sync Attempt Statistics: { failedInitialSyncAttempts: 0, maxFailedInitialSyncAttempts: 10, initialSyncStart: new Date(1511027292201), initialSyncAttempts: [] }
2017-11-18T17:48:21.216+0000 E REPL     [replication-1] Initial sync attempt failed -- attempts left: 9 cause: InitialSyncOplogSourceMissing: No valid sync source found in current replica set to do an initial sync.
2017-11-18T17:48:22.192+0000 I REPL     [replexec-1] Member 172.31.34.92:27017 is now in state PRIMARY
2017-11-18T17:48:22.216+0000 I REPL     [replication-0] Starting initial sync (attempt 2 of 10)
2017-11-18T17:48:22.216+0000 I STORAGE  [replication-0] Finishing collection drop for local.temp_oplog_buffer (no UUID).
2017-11-18T17:48:22.219+0000 I STORAGE  [replication-0] createCollection: local.temp_oplog_buffer with no UUID.
2017-11-18T17:48:22.227+0000 I REPL     [replication-0] chaining not allowed, choosing primary as sync source candidate: 172.31.34.92:27017
2017-11-18T17:48:22.227+0000 I REPL     [replication-0] ******
2017-11-18T17:48:22.227+0000 I REPL     [replication-0] creating replication oplog of size: 990MB...
2017-11-18T17:48:22.227+0000 I STORAGE  [replication-0] createCollection: local.oplog.rs with no UUID.
2017-11-18T17:48:22.233+0000 I STORAGE  [replication-0] Starting WiredTigerRecordStoreThread local.oplog.rs
2017-11-18T17:48:22.233+0000 I STORAGE  [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes
2017-11-18T17:48:22.233+0000 I STORAGE  [replication-0] Scanning the oplog to determine where to place markers for truncation
2017-11-18T17:48:22.270+0000 I REPL     [replication-0] ******
2017-11-18T17:48:22.270+0000 I STORAGE  [replication-0] dropAllDatabasesExceptLocal 1
2017-11-18T17:48:22.270+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.92:27017
2017-11-18T17:48:22.270+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.92:27017, took 0ms (1 connections now open to 172.31.34.92:27017)
2017-11-18T17:48:22.272+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.92:27017
2017-11-18T17:48:22.272+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.92:27017, took 0ms (2 connections now open to 172.31.34.92:27017)
2017-11-18T17:48:22.272+0000 I REPL     [replication-0] CollectionCloner::start called, on ns:admin.system.version
2017-11-18T17:48:22.273+0000 I STORAGE  [repl writer worker 15] createCollection: admin.system.version with provided UUID: 3de81043-a1c2-4137-b59d-ef57c4daea67
2017-11-18T17:48:22.282+0000 I INDEX    [repl writer worker 15] build index on: admin.system.version properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" }
2017-11-18T17:48:22.282+0000 I INDEX    [repl writer worker 15] 	 building index using bulk method; build may temporarily use up to 500 megabytes of RAM
2017-11-18T17:48:22.282+0000 I COMMAND  [repl writer worker 0] setting featureCompatibilityVersion to 3.6
2017-11-18T17:48:22.282+0000 I NETWORK  [repl writer worker 0] Skip closing connection for connection # 4
2017-11-18T17:48:22.282+0000 I NETWORK  [repl writer worker 0] Skip closing connection for connection # 2
2017-11-18T17:48:22.282+0000 I REPL     [repl writer worker 0] CollectionCloner ns:admin.system.version finished cloning with status: OK
2017-11-18T17:48:22.285+0000 I REPL     [repl writer worker 0] CollectionCloner::start called, on ns:admin.system.keys
2017-11-18T17:48:22.285+0000 I STORAGE  [repl writer worker 1] createCollection: admin.system.keys with provided UUID: 5c83a534-3f33-4a4e-a454-0f80d25df3a1
2017-11-18T17:48:22.296+0000 I INDEX    [repl writer worker 1] build index on: admin.system.keys properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "admin.system.keys" }
2017-11-18T17:48:22.296+0000 I INDEX    [repl writer worker 1] 	 building index using bulk method; build may temporarily use up to 500 megabytes of RAM
2017-11-18T17:48:22.297+0000 I REPL     [repl writer worker 2] CollectionCloner ns:admin.system.keys finished cloning with status: OK
2017-11-18T17:48:22.300+0000 I REPL     [replication-1] CollectionCloner::start called, on ns:config.transactions
2017-11-18T17:48:22.300+0000 I STORAGE  [repl writer worker 3] createCollection: config.transactions with provided UUID: 1d1e5517-d84c-4420-bade-a702eec45638
2017-11-18T17:48:22.310+0000 I INDEX    [repl writer worker 3] build index on: config.transactions properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "config.transactions" }
2017-11-18T17:48:22.310+0000 I INDEX    [repl writer worker 3] 	 building index using bulk method; build may temporarily use up to 500 megabytes of RAM
2017-11-18T17:48:22.310+0000 W REPL     [repl writer worker 6] _insertDocumentsCallback, but no documents to insert for ns:config.transactions
2017-11-18T17:48:22.310+0000 I REPL     [repl writer worker 6] CollectionCloner ns:config.transactions finished cloning with status: OK
2017-11-18T17:48:22.311+0000 I REPL     [repl writer worker 6] Finished cloning data: OK. Beginning oplog replay.
2017-11-18T17:48:22.311+0000 I REPL     [replication-0] No need to apply operations. (currently at { : Timestamp(1511027301, 4) })
2017-11-18T17:48:22.312+0000 I COMMAND  [replication-1] Assigning UUID 2fc4930b-532d-472c-8e2d-5b324bc96a26 to collection local.system.rollback.id
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID 8b9c3b60-8cab-476d-8b43-cbfa7519c565 to collection local.temp_oplog_buffer
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID 701f4385-e5c8-444d-91f5-21a40a2678ce to collection local.system.replset
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID 6f125cd5-a697-4788-b5a5-0c31dafa1381 to collection local.me
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID efed0345-7de3-4797-a965-303ad0b5ae9e to collection local.startup_log
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID 17c0fe19-49b2-45f3-82bf-5724c389553a to collection local.replset.minvalid
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID dfff4c7a-b04e-4065-8d21-e3586beb794b to collection local.oplog.rs
2017-11-18T17:48:22.313+0000 I COMMAND  [replication-1] Assigning UUID 48c218c4-22ab-49c1-8e6f-8ce634aa3e22 to collection local.replset.election
2017-11-18T17:48:22.313+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Ending connection to host 172.31.34.92:27017 due to bad connection status; 1 connections to that host remain open
2017-11-18T17:48:22.313+0000 I REPL     [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: error in fetcher batch callback: oplog fetcher is shutting down. Last fetched optime and hash: { ts: Timestamp(0, 0), t: -1 }[0]
2017-11-18T17:48:22.313+0000 I REPL     [replication-0] Initial sync attempt finishing up.
2017-11-18T17:48:22.313+0000 I REPL     [replication-0] Initial Sync Attempt Statistics: { failedInitialSyncAttempts: 1, maxFailedInitialSyncAttempts: 10, initialSyncStart: new Date(1511027292201), initialSyncAttempts: [ { durationMillis: 0, status: "InitialSyncOplogSourceMissing: No valid sync source found in current replica set to do an initial sync.", syncSource: ":27017" } ], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp(1511027301, 4), initialSyncOplogEnd: Timestamp(1511027301, 4), databases: { databasesCloned: 2, admin: { collections: 2, clonedCollections: 2, start: new Date(1511027302272), end: new Date(1511027302300), elapsedMillis: 28, admin.system.version: { documentsToCopy: 1, documentsCopied: 1, indexes: 1, fetchedBatches: 1, start: new Date(1511027302272), end: new Date(1511027302285), elapsedMillis: 13 }, admin.system.keys: { documentsToCopy: 1, documentsCopied: 1, indexes: 1, fetchedBatches: 1, start: new Date(1511027302285), end: new Date(1511027302300), elapsedMillis: 15 } }, config: { collections: 1, clonedCollections: 1, start: new Date(1511027302299), end: new Date(1511027302311), elapsedMillis: 12, config.transactions: { documentsToCopy: 0, documentsCopied: 0, indexes: 1, fetchedBatches: 0, start: new Date(1511027302300), end: new Date(1511027302311), elapsedMillis: 11 } } } }
2017-11-18T17:48:22.313+0000 I STORAGE  [replication-0] Finishing collection drop for local.temp_oplog_buffer (8b9c3b60-8cab-476d-8b43-cbfa7519c565).
2017-11-18T17:48:22.317+0000 I REPL     [replication-0] initial sync done; took 10s.
2017-11-18T17:48:22.317+0000 I REPL     [replication-0] transition to RECOVERING from STARTUP2
2017-11-18T17:48:22.317+0000 I REPL     [replication-0] Starting replication fetcher thread
2017-11-18T17:48:22.317+0000 I REPL     [replication-0] Starting replication applier thread
2017-11-18T17:48:22.317+0000 I REPL     [replication-0] Starting replication reporter thread
2017-11-18T17:48:22.318+0000 I REPL     [rsBackgroundSync] chaining not allowed, choosing primary as sync source candidate: 172.31.34.92:27017
2017-11-18T17:48:22.318+0000 I REPL     [rsSync] transition to SECONDARY from RECOVERING
2017-11-18T17:48:22.318+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.92:27017
2017-11-18T17:48:22.319+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.92:27017, took 1ms (2 connections now open to 172.31.34.92:27017)
2017-11-18T17:48:22.319+0000 W REPL     [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source's last applied OpTime { ts: Timestamp(1511027301, 4), t: 1 } is not greater than our last fetched OpTime { ts: Timestamp(1511027301, 4), t: 1 }. Choosing new sync source.
2017-11-18T17:48:22.319+0000 I REPL     [rsBackgroundSync] chaining not allowed, choosing primary as sync source candidate: 172.31.34.92:27017
2017-11-18T17:48:22.319+0000 I REPL     [rsBackgroundSync] Chose same sync source candidate as last time, 172.31.34.92:27017. Sleeping for 1 second to avoid immediately choosing a new sync source for the same reason as last time.
2017-11-18T17:48:23.320+0000 I STORAGE  [rsSync] createCollection: local.replset.oplogTruncateAfterPoint with generated UUID: e302da2b-0f3e-42e6-8a13-b491d72346d3
2017-11-18T17:48:27.193+0000 I REPL     [replexec-2] Member 172.31.34.57:27017 is now in state SECONDARY
2017-11-18T17:49:44.137+0000 I STORAGE  [repl writer worker 1] createCollection: test.c with provided UUID: 2707b382-fa37-4cec-aa76-b844e74b77b1
2017-11-18T17:51:39.122+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Ending connection to host 172.31.34.92:27017 due to bad connection status; 1 connections to that host remain open
2017-11-18T17:51:39.122+0000 I REPL     [replication-1] Restarting oplog query due to error: ExceededTimeLimit: error in fetcher batch callback: Operation timed out. Last fetched optime (with hash): { ts: Timestamp(1511027488, 17), t: 1 }[1005646539139698744]. Restarts remaining: 3
2017-11-18T17:51:39.122+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.92:27017
2017-11-18T17:51:39.122+0000 I REPL     [replication-1] Scheduled new oplog query Fetcher source: 172.31.34.92:27017 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1511027488, 17) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1511027488, 17) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 65000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 160994 -- target:172.31.34.92:27017 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1511027488, 17) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1511027488, 17) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms
2017-11-18T17:51:39.632+0000 I REPL     [replexec-0] Starting an election, since we've seen no PRIMARY in the past 10000ms
2017-11-18T17:51:39.632+0000 I REPL     [replexec-0] conducting a dry run election to see if we could be elected. current term: 1
2017-11-18T17:51:39.632+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T17:51:39.632+0000 I REPL     [replexec-2] VoteRequester(term 1 dry run) received a no vote from 172.31.34.57:27017 with reason "candidate's data is staler than mine. candidate's last applied OpTime: { ts: Timestamp(1511027488, 17), t: 1 }, my last applied OpTime: { ts: Timestamp(1511027490, 4), t: 1 }"; response message: { term: 1, voteGranted: false, reason: "candidate's data is staler than mine. candidate's last applied OpTime: { ts: Timestamp(1511027488, 17), t: 1 }, my last applied OpTime: { ts: Timestam...", ok: 1.0, operationTime: Timestamp(1511027490, 4), $clusterTime: { clusterTime: Timestamp(1511027490, 310), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } }
2017-11-18T17:51:41.112+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Ending connection to host 172.31.34.92:27017 due to bad connection status; 1 connections to that host remain open
2017-11-18T17:51:41.112+0000 I REPL_HB  [replexec-0] Error in heartbeat (requestId: 160984) to 172.31.34.92:27017, response status: ExceededTimeLimit: Operation timed out
2017-11-18T17:51:41.112+0000 I REPL     [replexec-0] Member 172.31.34.92:27017 is now in state RS_DOWN
2017-11-18T17:51:43.112+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T17:51:47.114+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.92:27017, took 7992ms (2 connections now open to 172.31.34.92:27017)
2017-11-18T17:51:47.114+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.92:27017, took 7482ms (2 connections now open to 172.31.34.92:27017)
2017-11-18T17:51:47.116+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.92:27017, took 4004ms (2 connections now open to 172.31.34.92:27017)
2017-11-18T17:51:47.116+0000 I REPL     [replexec-0] VoteRequester(term 1 dry run) received a no vote from 172.31.34.92:27017 with reason "candidate's data is staler than mine. candidate's last applied OpTime: { ts: Timestamp(1511027488, 17), t: 1 }, my last applied OpTime: { ts: Timestamp(1511027501, 1), t: 1 }"; response message: { term: 1, voteGranted: false, reason: "candidate's data is staler than mine. candidate's last applied OpTime: { ts: Timestamp(1511027488, 17), t: 1 }, my last applied OpTime: { ts: Timestam...", ok: 1.0, operationTime: Timestamp(1511027501, 1), $clusterTime: { clusterTime: Timestamp(1511027504, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } }
2017-11-18T17:51:47.117+0000 I REPL     [replexec-0] not running for primary, we have been superseded already during dry run. original term: 1, current term: 2
2017-11-18T17:51:47.117+0000 I REPL     [replexec-2] Member 172.31.34.92:27017 is now in state SECONDARY
2017-11-18T17:51:47.124+0000 I REPL     [replication-0] Restarting oplog query due to error: StaleTerm: error in fetcher batch callback: Replication term of this node was stale; retry query. Last fetched optime (with hash): { ts: Timestamp(1511027501, 1), t: 1 }[1309303445632519474]. Restarts remaining: 3
2017-11-18T17:51:47.124+0000 I REPL     [replication-0] Scheduled new oplog query Fetcher source: 172.31.34.92:27017 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1511027501, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, batchSize: 13981010, term: 2 } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 65000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 161017 -- target:172.31.34.92:27017 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1511027501, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, batchSize: 13981010, term: 2 } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms
2017-11-18T17:51:47.124+0000 W REPL     [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source's last applied OpTime { ts: Timestamp(1511027501, 1), t: 1 } is not greater than our last fetched OpTime { ts: Timestamp(1511027501, 1), t: 1 }. Choosing new sync source.
2017-11-18T17:51:47.134+0000 I ASIO     [replexec-6] dropping unhealthy pooled connection to 172.31.34.92:27017
2017-11-18T17:51:47.134+0000 I ASIO     [replexec-6] dropping unhealthy pooled connection to 172.31.34.92:27017
2017-11-18T17:51:47.134+0000 I ASIO     [replexec-6] after drop, pool was empty, going to spawn some connections
2017-11-18T17:51:47.134+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T17:51:47.135+0000 I REPL     [replexec-0] Member 172.31.34.57:27017 is now in state PRIMARY
2017-11-18T17:51:47.135+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.92:27017, took 1ms (1 connections now open to 172.31.34.92:27017)
2017-11-18T17:51:47.135+0000 I REPL     [SyncSourceFeedback] SyncSourceFeedback error sending update to 172.31.34.92:27017: InvalidSyncSource: Sync source was cleared. Was 172.31.34.92:27017
2017-11-18T17:51:48.134+0000 I REPL     [rsBackgroundSync] chaining not allowed, choosing primary as sync source candidate: 172.31.34.57:27017
2017-11-18T17:51:48.134+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.57:27017
2017-11-18T17:51:48.135+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.57:27017, took 1ms (1 connections now open to 172.31.34.57:27017)
2017-11-18T17:51:48.136+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Connecting to 172.31.34.57:27017
2017-11-18T17:51:48.136+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Successfully connected to 172.31.34.57:27017, took 0ms (2 connections now open to 172.31.34.57:27017)
2017-11-18T17:52:02.138+0000 I ASIO     [replexec-0] dropping unhealthy pooled connection to 172.31.34.57:27017
2017-11-18T17:52:02.138+0000 I ASIO     [replexec-0] after drop, pool was empty, going to spawn some connections
2017-11-18T17:52:02.138+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.57:27017
2017-11-18T17:52:02.138+0000 I REPL     [replexec-2] Member 172.31.34.92:27017 is now in state PRIMARY
2017-11-18T17:52:02.139+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.31.34.57:27017, took 1ms (1 connections now open to 172.31.34.57:27017)
2017-11-18T17:52:02.139+0000 I REPL     [replexec-5] Member 172.31.34.57:27017 is now in state SECONDARY
2017-11-18T17:52:47.114+0000 I ASIO     [NetworkInterfaceASIO-RS-0] Ending idle connection to host 172.31.34.92:27017 because the pool meets constraints; 1 connections to that host remain open
2017-11-18T17:52:58.508+0000 I NETWORK  [listener] connection accepted from 172.31.34.57:47794 #5 (3 connections now open)
2017-11-18T17:52:58.508+0000 I NETWORK  [conn5] received client metadata from 172.31.34.57:47794 conn: { driver: { name: "MongoDB Internal Client", version: "3.6.0-rc4-41-ge608b8b349" }, os: { type: "Linux", name: "SUSE Linux Enterprise Server 12 (x86_64)", architecture: "x86_64", version: "Kernel 4.4.92-6.18-default" } }
2017-11-18T17:53:01.888+0000 I NETWORK  [thread1] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:53:01.897+0000 I NETWORK  [listener] connection accepted from 172.31.40.189:49236 #6 (4 connections now open)
2017-11-18T17:53:01.897+0000 I NETWORK  [conn6] received client metadata from 172.31.40.189:49236 conn: { driver: { name: "MongoDB Internal Client", version: "3.6.0-rc4-41-ge608b8b349" }, os: { type: "Linux", name: "SUSE Linux Enterprise Server 12 (x86_64)", architecture: "x86_64", version: "Kernel 4.4.92-6.18-default" } }
2017-11-18T17:53:01.897+0000 I NETWORK  [thread1] Successfully connected to 172.31.40.189:27017 (1 connections now open to 172.31.40.189:27017 with a 5 second timeout)
2017-11-18T17:53:01.898+0000 I NETWORK  [ReplicaSetMonitor-TaskExecutor-0] Successfully connected to 172.31.34.92:27017 (1 connections now open to 172.31.34.92:27017 with a 5 second timeout)
2017-11-18T17:53:01.898+0000 I NETWORK  [thread1] Successfully connected to 172.31.34.57:27017 (1 connections now open to 172.31.34.57:27017 with a 5 second timeout)
2017-11-18T17:53:01.898+0000 I NETWORK  [thread1] Successfully connected to 172.31.34.92:27017 (1 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:53:01.898+0000 I NETWORK  [thread1] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:53:01.899+0000 I NETWORK  [thread1] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:53:01.899+0000 I NETWORK  [thread1] Successfully connected to 172.31.34.92:27017 (2 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:53:01.899+0000 I NETWORK  [thread1] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:53:01.900+0000 I NETWORK  [thread1] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:53:01.900+0000 I NETWORK  [thread1] Successfully connected to 172.31.34.92:27017 (3 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:53:01.900+0000 I NETWORK  [thread1] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:53:01.901+0000 I NETWORK  [thread1] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:53:01.902+0000 I NETWORK  [thread1] Successfully connected to 172.31.34.92:27017 (4 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:53:01.902+0000 I NETWORK  [thread1] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:53:10.165+0000 I STORAGE  [repl writer worker 2] createCollection: config.system.sessions with provided UUID: 56c9d2d5-ad98-4c81-b1bb-141d9aab6483
2017-11-18T17:53:10.183+0000 I INDEX    [repl writer worker 14] build index on: config.system.sessions properties: { v: 2, key: { lastUse: 1 }, name: "lsidTTLIndex", expireAfterSeconds: 1800, ns: "config.system.sessions" }
2017-11-18T17:53:10.183+0000 I INDEX    [repl writer worker 14] 	 building index using bulk method; build may temporarily use up to 500 megabytes of RAM
2017-11-18T17:53:10.184+0000 I INDEX    [repl writer worker 14] build index done.  scanned 0 total records. 0 secs
2017-11-18T17:58:01.888+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:58:01.889+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (5 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:58:01.889+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:58:01.889+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:58:01.890+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (6 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:58:01.890+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:58:01.890+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:58:01.891+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (7 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:58:01.891+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T17:58:01.891+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T17:58:01.892+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (8 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T17:58:01.892+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:03:01.888+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:03:01.889+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (9 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:03:01.889+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:03:01.889+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:03:01.890+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (10 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:03:01.890+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:03:01.890+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:03:01.891+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (11 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:03:01.891+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:03:01.891+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:03:01.892+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (12 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:03:01.892+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:08:01.888+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:08:01.889+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (13 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:08:01.889+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:08:01.890+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:08:01.890+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (14 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:08:01.890+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:08:01.890+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:08:01.891+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (15 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:08:01.891+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:08:01.891+0000 I NETWORK  [thread2] Starting new replica set monitor for rs/172.31.34.57:27017,172.31.34.92:27017,172.31.40.189:27017
2017-11-18T18:08:01.892+0000 I NETWORK  [thread2] Successfully connected to 172.31.34.92:27017 (16 connections now open to 172.31.34.92:27017 with a 0 second timeout)
2017-11-18T18:08:01.892+0000 I NETWORK  [thread2] scoped connection to 172.31.34.92:27017 not being returned to the pool
2017-11-18T18:09:12.472+0000 I NETWORK  [worker-3] end connection 172.31.34.92:34908 (3 connections now open)
2017-11-18T18:09:14.394+0000 I ASIO     [replexec-15] dropping unhealthy pooled connection to 172.31.34.92:27017
2017-11-18T18:09:14.394+0000 I ASIO     [replexec-15] after drop, pool was empty, going to spawn some connections
2017-11-18T18:09:14.394+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:14.394+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:14.394+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:14.394+0000 I REPL_HB  [replexec-17] Error in heartbeat (requestId: 164478) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:14.395+0000 I REPL_HB  [replexec-17] Error in heartbeat (requestId: 164482) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:14.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:14.395+0000 I REPL_HB  [replexec-13] Error in heartbeat (requestId: 164484) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:14.395+0000 I REPL     [replexec-13] Member 172.31.34.92:27017 is now in state RS_DOWN
2017-11-18T18:09:16.395+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:16.396+0000 I REPL_HB  [replexec-15] Error in heartbeat (requestId: 164488) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:16.396+0000 I REPL_HB  [replexec-13] Error in heartbeat (requestId: 164490) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:16.396+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:16.396+0000 I REPL_HB  [replexec-15] Error in heartbeat (requestId: 164492) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:17.185+0000 I REPL     [replication-3] Choosing new sync source because our current sync source, 172.31.34.57:27017, has an OpTime ({ ts: Timestamp(1511028551, 1), t: 3 }) which is not ahead of ours ({ ts: Timestamp(1511028551, 1), t: 3 }), it does not have a sync source, and it's not the primary (sync source does not know the primary)
2017-11-18T18:09:17.185+0000 I REPL     [replication-3] Canceling oplog query due to OplogQueryMetadata. We have to choose a new sync source. Current source: 172.31.34.57:27017, OpTime { ts: Timestamp(1511028551, 1), t: 3 }, its sync source index:-1
2017-11-18T18:09:17.186+0000 W REPL     [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: sync source 172.31.34.57:27017 (config version: 1; last applied optime: { ts: Timestamp(1511028551, 1), t: 3 }; sync source index: -1; primary index: -1) is no longer valid
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:17.187+0000 I REPL_HB  [replexec-19] Error in heartbeat (requestId: 164496) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:17.187+0000 I REPL_HB  [replexec-18] Error in heartbeat (requestId: 164501) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:17.187+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:17.187+0000 I REPL_HB  [replexec-13] Error in heartbeat (requestId: 164503) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:17.193+0000 I REPL     [SyncSourceFeedback] SyncSourceFeedback error sending update to 172.31.34.57:27017: InvalidSyncSource: Sync source was cleared. Was 172.31.34.57:27017
2017-11-18T18:09:22.188+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:22.188+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:22.188+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:22.188+0000 I REPL_HB  [replexec-18] Error in heartbeat (requestId: 164507) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:22.189+0000 I REPL_HB  [replexec-19] Error in heartbeat (requestId: 164509) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 172.31.34.92:27017
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to 172.31.34.92:27017 - HostUnreachable: Connection refused
2017-11-18T18:09:22.189+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to 172.31.34.92:27017 due to failed operation on a connection
2017-11-18T18:09:22.189+0000 I REPL_HB  [replexec-17] Error in heartbeat (requestId: 164511) to 172.31.34.92:27017, response status: HostUnreachable: Connection refused
2017-11-18T18:09:22.217+0000 I CONTROL  [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends
2017-11-18T18:09:22.217+0000 I NETWORK  [signalProcessingThread] shutdown: going to close listening sockets...
2017-11-18T18:09:22.218+0000 I REPL     [signalProcessingThread] shutting down replication subsystems
2017-11-18T18:09:22.218+0000 I REPL     [signalProcessingThread] Stopping replication reporter thread
2017-11-18T18:09:22.218+0000 I REPL     [signalProcessingThread] Stopping replication fetcher thread
2017-11-18T18:09:22.218+0000 I REPL     [signalProcessingThread] Stopping replication applier thread
2017-11-18T18:09:23.188+0000 I REPL     [signalProcessingThread] Stopping replication storage threads
2017-11-18T18:09:23.193+0000 I FTDC     [signalProcessingThread] Shutting down full-time diagnostic data capture
2017-11-18T18:09:23.195+0000 I STORAGE  [WTOplogJournalThread] oplog journal thread loop shutting down
2017-11-18T18:09:23.195+0000 I STORAGE  [signalProcessingThread] WiredTigerKVEngine shutting down
2017-11-18T18:09:23.274+0000 I STORAGE  [signalProcessingThread] shutdown: removing fs lock...
2017-11-18T18:09:23.274+0000 I CONTROL  [signalProcessingThread] now exiting
2017-11-18T18:09:23.274+0000 I CONTROL  [signalProcessingThread] shutting down with code:0