2018-10-04T11:54:38.016-0400 I CONTROL [initandlisten] MongoDB starting : pid=23302 port=9008 dbpath=/tmp/mms-automation/test/output/data/process9008 64-bit host=jazzstep-2.local 2018-10-04T11:54:38.016-0400 I CONTROL [initandlisten] db version v4.0.3-rc0 2018-10-04T11:54:38.017-0400 I CONTROL [initandlisten] git version: 7ea530946fa7880364d88c8d8b6026bbc9ffa48c 2018-10-04T11:54:38.017-0400 I CONTROL [initandlisten] allocator: system 2018-10-04T11:54:38.018-0400 I CONTROL [initandlisten] modules: none 2018-10-04T11:54:38.018-0400 I CONTROL [initandlisten] build environment: 2018-10-04T11:54:38.019-0400 I CONTROL [initandlisten] distarch: x86_64 2018-10-04T11:54:38.019-0400 I CONTROL [initandlisten] target_arch: x86_64 2018-10-04T11:54:38.019-0400 I CONTROL [initandlisten] options: { config: "/tmp/mms-automation/test/output/data/process9008/automation-mongod.conf", net: { bindIp: "0.0.0.0", port: 9008 }, processManagement: { fork: true }, replication: { oplogSizeMB: 64, replSetName: "csrs" }, sharding: { clusterRole: "configsvr" }, storage: { dbPath: "/tmp/mms-automation/test/output/data/process9008", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", path: "/tmp/mms-automation/test/logs/run9008" } } 2018-10-04T11:54:38.021-0400 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress), 2018-10-04T11:54:38.514-0400 I STORAGE [initandlisten] WiredTiger message [1538668478:514040][23302:0x7fff8d0db380], txn-recover: Set global recovery timestamp: 0 2018-10-04T11:54:38.540-0400 I RECOVERY [initandlisten] WiredTiger recoveryTimestamp. Ts: Timestamp(0, 0) 2018-10-04T11:54:38.580-0400 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2018-10-04T11:54:38.581-0400 I CONTROL [initandlisten] 2018-10-04T11:54:38.582-0400 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-10-04T11:54:38.582-0400 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-10-04T11:54:38.583-0400 I CONTROL [initandlisten] 2018-10-04T11:54:38.590-0400 I STORAGE [initandlisten] createCollection: local.startup_log with generated UUID: 4346d4ea-cdaf-4c15-9b7b-1e4d6601e248 2018-10-04T11:54:38.627-0400 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/tmp/mms-automation/test/output/data/process9008/diagnostic.data' 2018-10-04T11:54:38.635-0400 I SHARDING [thread1] creating distributed lock ping thread for process ConfigServer (sleeping for 30000ms) 2018-10-04T11:54:38.635-0400 I SHARDING [shard registry reload] Periodic reload of shard registry failed :: caused by :: ReadConcernMajorityNotAvailableYet: could not get updated shard list from config server :: caused by :: Read concern majority reads are currently not possible.; will retry after 30s 2018-10-04T11:54:38.635-0400 I STORAGE [initandlisten] createCollection: local.replset.oplogTruncateAfterPoint with generated UUID: a1b6eb62-cbd3-4670-8388-c4e9069bcd9b 2018-10-04T11:54:38.672-0400 I STORAGE [initandlisten] createCollection: local.replset.minvalid with generated UUID: eb148510-8384-4a18-a78e-b7f5e54b6faf 2018-10-04T11:54:38.709-0400 I REPL [initandlisten] Did not find local voted for document at startup. 2018-10-04T11:54:38.710-0400 I REPL [initandlisten] Did not find local Rollback ID document at startup. Creating one. 2018-10-04T11:54:38.710-0400 I STORAGE [initandlisten] createCollection: local.system.rollback.id with generated UUID: 096ca6d0-ca61-4367-9f63-58ed799d0451 2018-10-04T11:54:38.745-0400 I REPL [initandlisten] Initialized the rollback ID to 1 2018-10-04T11:54:38.746-0400 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2018-10-04T11:54:38.747-0400 I NETWORK [initandlisten] waiting for connections on port 9008 2018-10-04T11:54:38.747-0400 I SH_REFR [ConfigServerCatalogCacheLoader-0] Refresh for database config took 0 ms and found { _id: "config", primary: "config", partitioned: true } 2018-10-04T11:54:38.762-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Cannot create config.system.sessions until there are shards, will try again at the next refresh interval 2018-10-04T11:54:38.762-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Cannot create config.system.sessions until there are shards 2018-10-04T11:54:39.610-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58847 #1 (1 connection now open) 2018-10-04T11:54:39.611-0400 I ACCESS [conn1] SASL SCRAM-SHA-1 authentication failed for __system on local from client 10.1.25.36:58847 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:39.611-0400 I NETWORK [conn1] end connection 10.1.25.36:58847 (0 connections now open) 2018-10-04T11:54:39.613-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58848 #2 (1 connection now open) 2018-10-04T11:54:39.614-0400 I ACCESS [conn2] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:39.614-0400 I ACCESS [conn2] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 10.1.25.36:58848 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:39.615-0400 I NETWORK [conn2] end connection 10.1.25.36:58848 (0 connections now open) 2018-10-04T11:54:39.616-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58849 #3 (1 connection now open) 2018-10-04T11:54:39.633-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58856 #4 (2 connections now open) 2018-10-04T11:54:39.634-0400 I NETWORK [conn4] end connection 10.1.25.36:58856 (1 connection now open) 2018-10-04T11:54:39.637-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58858 #5 (2 connections now open) 2018-10-04T11:54:39.638-0400 I NETWORK [conn5] received client metadata from 10.1.25.36:58858 conn5: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:39.639-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:41.659-0400 I STORAGE [replexec-0] createCollection: local.system.replset with generated UUID: ef041b12-468a-402b-b03a-d969342d2ff0 2018-10-04T11:54:41.660-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58865 #9 (3 connections now open) 2018-10-04T11:54:41.661-0400 I NETWORK [conn9] end connection 10.1.25.36:58865 (2 connections now open) 2018-10-04T11:54:41.717-0400 I REPL [replexec-0] New replica set config in use: { _id: "csrs", version: 1, configsvr: true, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "jazzstep-2.local:9007", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "jazzstep-2.local:9008", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "jazzstep-2.local:9009", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('5bb637bf290d7fa45d18bef1') } } 2018-10-04T11:54:41.719-0400 I REPL [replexec-0] This node is jazzstep-2.local:9008 in the config 2018-10-04T11:54:41.720-0400 I REPL [replexec-0] transition to STARTUP2 from STARTUP 2018-10-04T11:54:41.721-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T11:54:41.721-0400 I REPL [replexec-0] Starting replication storage threads 2018-10-04T11:54:41.723-0400 I REPL [replexec-3] Member jazzstep-2.local:9007 is now in state SECONDARY 2018-10-04T11:54:41.726-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58867 #11 (3 connections now open) 2018-10-04T11:54:41.727-0400 I STORAGE [replexec-0] createCollection: local.temp_oplog_buffer with generated UUID: fffb03d4-fa64-47b5-9114-3db2940d0b3b 2018-10-04T11:54:41.728-0400 I NETWORK [conn11] received client metadata from 10.1.25.36:58867 conn11: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:41.748-0400 I REPL [replexec-2] Member jazzstep-2.local:9009 is now in state STARTUP2 2018-10-04T11:54:41.780-0400 I REPL [replication-0] Starting initial sync (attempt 1 of 10) 2018-10-04T11:54:41.781-0400 I STORAGE [replication-0] Finishing collection drop for local.temp_oplog_buffer (fffb03d4-fa64-47b5-9114-3db2940d0b3b). 2018-10-04T11:54:41.817-0400 I STORAGE [replication-0] createCollection: local.temp_oplog_buffer with generated UUID: e516011f-f16f-42ce-b1fe-a24eba02e80a 2018-10-04T11:54:41.889-0400 I REPL [replication-0] sync source candidate: jazzstep-2.local:9007 2018-10-04T11:54:41.890-0400 I REPL [replication-0] Initial syncer oplog truncation finished in: 0ms 2018-10-04T11:54:41.891-0400 I REPL [replication-0] ****** 2018-10-04T11:54:41.893-0400 I REPL [replication-0] creating replication oplog of size: 64MB... 2018-10-04T11:54:41.893-0400 I STORAGE [replication-0] createCollection: local.oplog.rs with generated UUID: 8b25ed10-7dcc-4012-9318-b9d54ab2b2f6 2018-10-04T11:54:41.914-0400 I STORAGE [replication-0] Starting OplogTruncaterThread local.oplog.rs 2018-10-04T11:54:41.917-0400 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2018-10-04T11:54:41.923-0400 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2018-10-04T11:54:42.063-0400 I REPL [replication-0] ****** 2018-10-04T11:54:42.065-0400 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2018-10-04T11:54:42.066-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:42.079-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:42.084-0400 I REPL [replication-1] CollectionCloner::start called, on ns:admin.system.version 2018-10-04T11:54:42.097-0400 I STORAGE [repl writer worker 0] createCollection: admin.system.version with provided UUID: e7fcf9ad-9db8-444c-8c5f-7916f7ba4aba 2018-10-04T11:54:42.152-0400 I INDEX [repl writer worker 0] build index on: admin.system.version properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2018-10-04T11:54:42.153-0400 I INDEX [repl writer worker 0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:42.154-0400 I COMMAND [repl writer worker 1] setting featureCompatibilityVersion to 4.0 2018-10-04T11:54:42.155-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 11 2018-10-04T11:54:42.156-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 5 2018-10-04T11:54:42.156-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 3 2018-10-04T11:54:42.157-0400 I REPL [repl writer worker 1] CollectionCloner ns:admin.system.version finished cloning with status: OK 2018-10-04T11:54:42.161-0400 I REPL [repl writer worker 1] Finished cloning data: OK. Beginning oplog replay. 2018-10-04T11:54:42.162-0400 I REPL [replication-1] No need to apply operations. (currently at { : Timestamp(1538668479, 1) }) 2018-10-04T11:54:42.164-0400 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: error in fetcher batch callback: oplog fetcher is shutting down. Last fetched optime and hash: { ts: Timestamp(0, 0), t: -1 }[0] 2018-10-04T11:54:42.165-0400 I REPL [replication-0] Initial sync attempt finishing up. 2018-10-04T11:54:42.172-0400 I REPL [replication-0] Initial Sync Attempt Statistics: { failedInitialSyncAttempts: 0, maxFailedInitialSyncAttempts: 10, initialSyncStart: new Date(1538668481780), initialSyncAttempts: [], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp(1538668479, 1), initialSyncOplogEnd: Timestamp(1538668479, 1), databases: { databasesCloned: 1, admin: { collections: 1, clonedCollections: 1, start: new Date(1538668482083), end: new Date(1538668482162), elapsedMillis: 79, admin.system.version: { documentsToCopy: 1, documentsCopied: 1, indexes: 1, fetchedBatches: 1, start: new Date(1538668482089), end: new Date(1538668482162), elapsedMillis: 73 } } } } 2018-10-04T11:54:42.179-0400 I STORAGE [replication-0] Finishing collection drop for local.temp_oplog_buffer (e516011f-f16f-42ce-b1fe-a24eba02e80a). 2018-10-04T11:54:42.223-0400 I REPL [replication-0] initial sync done; took 0s. 2018-10-04T11:54:42.224-0400 I REPL [replication-0] transition to RECOVERING from STARTUP2 2018-10-04T11:54:42.227-0400 I REPL [replication-0] Starting replication fetcher thread 2018-10-04T11:54:42.228-0400 I REPL [replication-0] Starting replication applier thread 2018-10-04T11:54:42.228-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T11:54:42.229-0400 I REPL [replication-0] Starting replication reporter thread 2018-10-04T11:54:42.229-0400 I REPL [rsSync-0] Starting oplog application 2018-10-04T11:54:42.242-0400 I REPL [rsSync-0] transition to SECONDARY from RECOVERING 2018-10-04T11:54:42.243-0400 I REPL [rsSync-0] Resetting sync source to empty, which was :27017 2018-10-04T11:54:42.742-0400 I REPL [replexec-2] Member jazzstep-2.local:9009 is now in state SECONDARY 2018-10-04T11:54:50.978-0400 I STORAGE [conn5] createCollection: local.replset.election with generated UUID: 7aba01e6-dd0d-4042-bd8e-00991f3a7093 2018-10-04T11:54:51.055-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58872 #14 (4 connections now open) 2018-10-04T11:54:51.056-0400 I NETWORK [conn14] received client metadata from 10.1.25.36:58872 conn14: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:51.273-0400 I REPL [replexec-1] Member jazzstep-2.local:9007 is now in state PRIMARY 2018-10-04T11:54:52.084-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9007 due to bad connection status; 1 connections to that host remain open 2018-10-04T11:54:52.858-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58873 #15 (5 connections now open) 2018-10-04T11:54:52.860-0400 I ACCESS [conn15] SASL SCRAM-SHA-1 authentication failed for __system on local from client 127.0.0.1:58873 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:52.861-0400 I NETWORK [conn15] end connection 127.0.0.1:58873 (4 connections now open) 2018-10-04T11:54:52.861-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58874 #16 (5 connections now open) 2018-10-04T11:54:52.863-0400 I ACCESS [conn16] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:52.872-0400 I ACCESS [conn16] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 127.0.0.1:58874 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:52.875-0400 I NETWORK [conn16] end connection 127.0.0.1:58874 (4 connections now open) 2018-10-04T11:54:52.875-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58875 #17 (5 connections now open) 2018-10-04T11:54:54.258-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9007 2018-10-04T11:54:54.260-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9007 2018-10-04T11:54:54.262-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:54.264-0400 I STORAGE [repl writer worker 5] createCollection: config.chunks with provided UUID: 4acf8dfb-4484-4099-9f1f-ef02aa9c289f 2018-10-04T11:54:54.349-0400 I INDEX [repl writer worker 10] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:54.358-0400 I INDEX [repl writer worker 10] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.379-0400 I INDEX [repl writer worker 10] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.455-0400 I INDEX [repl writer worker 13] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, shard: 1, min: 1 }, name: "ns_1_shard_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:54.464-0400 I INDEX [repl writer worker 13] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.476-0400 I INDEX [repl writer worker 13] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.556-0400 I INDEX [repl writer worker 1] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, lastmod: 1 }, name: "ns_1_lastmod_1", ns: "config.chunks" } 2018-10-04T11:54:54.557-0400 I INDEX [repl writer worker 1] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.566-0400 I INDEX [repl writer worker 1] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.571-0400 I STORAGE [repl writer worker 3] createCollection: config.migrations with provided UUID: 2c153a2c-409d-4354-af8d-2da4c3dbabcb 2018-10-04T11:54:54.617-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58882 #19 (6 connections now open) 2018-10-04T11:54:54.663-0400 I INDEX [repl writer worker 7] build index on: config.migrations properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.migrations" } 2018-10-04T11:54:54.664-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.679-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.686-0400 I STORAGE [repl writer worker 10] createCollection: config.shards with provided UUID: 83541a41-5a83-4aaf-82e6-75a98c3b8535 2018-10-04T11:54:54.807-0400 I INDEX [repl writer worker 13] build index on: config.shards properties: { v: 2, unique: true, key: { host: 1 }, name: "host_1", ns: "config.shards" } 2018-10-04T11:54:54.808-0400 I INDEX [repl writer worker 13] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.814-0400 I INDEX [repl writer worker 13] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.816-0400 I STORAGE [repl writer worker 15] createCollection: config.locks with provided UUID: 9cd77010-8190-4320-9dc5-4063826f18a2 2018-10-04T11:54:54.925-0400 I INDEX [repl writer worker 3] build index on: config.locks properties: { v: 2, key: { ts: 1 }, name: "ts_1", ns: "config.locks" } 2018-10-04T11:54:54.926-0400 I INDEX [repl writer worker 3] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.931-0400 I INDEX [repl writer worker 3] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.972-0400 I INDEX [repl writer worker 7] build index on: config.locks properties: { v: 2, key: { state: 1, process: 1 }, name: "state_1_process_1", ns: "config.locks" } 2018-10-04T11:54:54.973-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.987-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.991-0400 I STORAGE [repl writer worker 10] createCollection: config.lockpings with provided UUID: 96955f75-9ab8-4b7a-9866-f90df07eda5e 2018-10-04T11:54:55.097-0400 I INDEX [repl writer worker 13] build index on: config.lockpings properties: { v: 2, key: { ping: 1 }, name: "ping_1", ns: "config.lockpings" } 2018-10-04T11:54:55.097-0400 I INDEX [repl writer worker 13] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.102-0400 I INDEX [repl writer worker 13] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.104-0400 I STORAGE [repl writer worker 15] createCollection: config.tags with provided UUID: 5c9b63ea-58bf-4bf6-b6f7-43dc7c12ac98 2018-10-04T11:54:55.209-0400 I INDEX [repl writer worker 3] build index on: config.tags properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.tags" } 2018-10-04T11:54:55.210-0400 I INDEX [repl writer worker 3] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.215-0400 I INDEX [repl writer worker 3] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.245-0400 I INDEX [repl writer worker 7] build index on: config.tags properties: { v: 2, key: { ns: 1, tag: 1 }, name: "ns_1_tag_1", ns: "config.tags" } 2018-10-04T11:54:55.246-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.253-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.260-0400 I STORAGE [repl writer worker 10] createCollection: config.version with provided UUID: 4653338a-2d1f-4b0d-be38-d33757459d0b 2018-10-04T11:54:55.331-0400 I STORAGE [repl writer worker 13] createCollection: config.transactions with provided UUID: 7e00fbae-25f1-43a1-a523-94d4c94e331a 2018-10-04T11:54:55.430-0400 I STORAGE [replication-1] Triggering the first stable checkpoint. Initial Data: Timestamp(1538668479, 1) PrevStable: Timestamp(0, 0) CurrStable: Timestamp(1538668493, 23) 2018-10-04T11:54:55.434-0400 I STORAGE [repl writer worker 15] createCollection: admin.system.keys with provided UUID: 62bf9df9-59de-4f87-9f5e-10442108a0e0 2018-10-04T11:54:55.770-0400 I COMMAND [monitoring keys for HMAC] command admin.system.keys command: find { find: "system.keys", filter: { purpose: "HMAC", expiresAt: { $gt: Timestamp(0, 0) } }, sort: { expiresAt: 1 }, $readPreference: { mode: "nearest", tags: [] }, $db: "admin" } planSummary: COLLSCAN keysExamined:0 docsExamined:0 hasSortStage:1 cursorExhausted:1 numYields:1 nreturned:0 reslen:320 locks:{ Global: { acquireCount: { r: 3 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 261701 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_msg 261ms 2018-10-04T11:55:00.981-0400 I NETWORK [conn5] end connection 10.1.25.36:58858 (5 connections now open) 2018-10-04T11:55:07.879-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58932 #20 (6 connections now open) 2018-10-04T11:55:09.620-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58934 #21 (7 connections now open) 2018-10-04T11:55:19.954-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58970 #22 (8 connections now open) 2018-10-04T11:55:19.954-0400 I NETWORK [conn22] received client metadata from 10.1.25.36:58970 conn22: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.960-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58973 #23 (9 connections now open) 2018-10-04T11:55:19.961-0400 I NETWORK [conn23] received client metadata from 10.1.25.36:58973 conn23: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.017-0400 I STORAGE [repl writer worker 10] createCollection: config.mongos with provided UUID: a968e6e5-dc3c-4cad-b545-d2e970cbad2b 2018-10-04T11:55:20.131-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58987 #24 (10 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58993 #25 (11 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [conn24] received client metadata from 10.1.25.36:58987 conn24: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.133-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58996 #26 (12 connections now open) 2018-10-04T11:55:20.133-0400 I NETWORK [conn25] received client metadata from 10.1.25.36:58993 conn25: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.137-0400 I NETWORK [conn26] received client metadata from 10.1.25.36:58996 conn26: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.159-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58998 #27 (13 connections now open) 2018-10-04T11:55:20.160-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59000 #28 (14 connections now open) 2018-10-04T11:55:20.160-0400 I NETWORK [conn27] received client metadata from 10.1.25.36:58998 conn27: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.161-0400 I NETWORK [conn28] received client metadata from 10.1.25.36:59000 conn28: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.260-0400 I STORAGE [repl writer worker 1] createCollection: config.changelog with provided UUID: 42c8c7b6-7f0a-4c5f-9b62-509e01fed92f 2018-10-04T11:55:20.417-0400 I STORAGE [repl writer worker 10] createCollection: config.databases with provided UUID: fe6cb2e2-5c5f-4138-a534-6174c0056936 2018-10-04T11:55:20.786-0400 I NETWORK [conn28] end connection 10.1.25.36:59000 (13 connections now open) 2018-10-04T11:55:20.787-0400 I NETWORK [conn25] end connection 10.1.25.36:58993 (12 connections now open) 2018-10-04T11:55:34.009-0400 I NETWORK [conn27] end connection 10.1.25.36:58998 (11 connections now open) 2018-10-04T11:55:34.009-0400 I NETWORK [conn24] end connection 10.1.25.36:58987 (10 connections now open) 2018-10-04T11:55:38.642-0400 I NETWORK [shard registry reload] Starting new replica set monitor for foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 2018-10-04T11:55:38.647-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9002 (1 connections now open to jazzstep-2.local:9002 with a 5 second timeout) 2018-10-04T11:55:38.649-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:04.252-0400 I STORAGE [repl writer worker 11] createCollection: config.actionlog with provided UUID: c5416714-1761-4e21-a2d0-8b64bb1c0cfc 2018-10-04T11:56:08.655-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:20.198-0400 I NETWORK [listener] connection accepted from 10.1.25.36:60569 #30 (11 connections now open) 2018-10-04T11:56:20.199-0400 I NETWORK [conn30] received client metadata from 10.1.25.36:60569 conn30: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:56:38.662-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:08.670-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:38.674-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:08.679-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:38.687-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:08.695-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:38.005-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49308 #31 (12 connections now open) 2018-10-04T11:59:38.006-0400 I NETWORK [conn31] received client metadata from 10.1.25.36:49308 conn31: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:59:38.703-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:38.754-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T11:59:38.760-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:07.078-0400 I NETWORK [conn17] end connection 127.0.0.1:58875 (11 connections now open) 2018-10-04T12:00:07.078-0400 I NETWORK [conn20] end connection 127.0.0.1:58932 (10 connections now open) 2018-10-04T12:00:07.078-0400 I NETWORK [conn3] end connection 10.1.25.36:58849 (9 connections now open) 2018-10-04T12:00:07.078-0400 I NETWORK [conn21] end connection 10.1.25.36:58934 (8 connections now open) 2018-10-04T12:00:07.078-0400 I NETWORK [conn19] end connection 10.1.25.36:58882 (7 connections now open) 2018-10-04T12:00:08.672-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:08.709-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:00:38.685-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:38.713-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:08.691-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:01:08.715-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:38.700-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:01:38.717-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:08.704-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:02:08.724-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:38.706-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:02:38.727-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:08.709-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:03:08.729-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:38.711-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:03:38.734-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:08.713-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:04:08.737-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:38.714-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:04:38.739-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:38.758-0400 I SH_REFR [ConfigServerCatalogCacheLoader-1] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:04:38.758-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:04:38.759-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:08.716-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:08.717-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:08.741-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:05:38.719-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:38.720-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:38.742-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:08.721-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:08.722-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:08.746-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:38.723-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:38.725-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:38.749-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:08.728-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:08.729-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:08.755-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:38.735-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:38.736-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:38.757-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:08.746-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:08.747-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:08.761-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:38.748-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:38.749-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:38.771-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:08.752-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:08.753-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:08.776-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:38.761-0400 I SH_REFR [ConfigServerCatalogCacheLoader-2] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:09:38.761-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:38.763-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:09:38.763-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:38.764-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:38.779-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:08.768-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b423d8f72c85d19095e and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:08.769-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:08.770-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:08.783-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:38.772-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b423d8f72c85d19095e and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:38.772-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:38.773-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:38.788-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:11:08.782-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b423d8f72c85d19095e and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:08.783-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ea3d8f72c85d190629 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:08.783-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:08.797-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:22:44.975-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:22:44.976-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9007 due to bad connection status; 0 connections to that host remain open 2018-10-04T12:22:44.979-0400 I REPL [replication-0] Restarting oplog query due to error: NetworkInterfaceExceededTimeLimit: error in fetcher batch callback :: caused by :: timed out. Last fetched optime (with hash): { ts: Timestamp(1538669483, 1), t: 1 }[3376758897828916176]. Restarts remaining: 1 2018-10-04T12:22:44.980-0400 I REPL [replication-0] Scheduled new oplog query Fetcher source: jazzstep-2.local:9007 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538669483, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1538669483, 1) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 7000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 2394 -- target:jazzstep-2.local:9007 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538669483, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1538669483, 1) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms 2018-10-04T12:22:44.981-0400 I NETWORK [conn11] end connection 10.1.25.36:58867 (6 connections now open) 2018-10-04T12:22:44.982-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.983-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.986-0400 I NETWORK [conn14] end connection 10.1.25.36:58872 (5 connections now open) 2018-10-04T12:22:45.017-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9007 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:45.017-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9009 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:45.018-0400 I REPL [replexec-6] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-10-04T12:22:45.018-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:45.019-0400 I REPL [replexec-6] conducting a dry run election to see if we could be elected. current term: 1 2018-10-04T12:22:45.020-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:22:45.021-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:45.021-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:22:46.888-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62630 #32 (6 connections now open) 2018-10-04T12:22:46.892-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62640 #38 (7 connections now open) 2018-10-04T12:22:46.892-0400 I NETWORK [conn32] received client metadata from 127.0.0.1:62630 conn32: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.893-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62649 #40 (8 connections now open) 2018-10-04T12:22:46.894-0400 I NETWORK [conn38] received client metadata from 127.0.0.1:62640 conn38: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.894-0400 I REPL [replexec-8] Member jazzstep-2.local:9007 is now in state SECONDARY 2018-10-04T12:22:46.894-0400 I REPL [replexec-9] VoteRequester(term 1 dry run) received a yes vote from jazzstep-2.local:9007; response message: { term: 1, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538669483, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('7fffffff0000000000000001') }, lastCommittedOpTime: Timestamp(1538669483, 1), $clusterTime: { clusterTime: Timestamp(1538669483, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:22:46.895-0400 I NETWORK [conn40] received client metadata from 127.0.0.1:62649 conn40: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.898-0400 I REPL [replexec-8] dry election run succeeded, running for election in term 2 2018-10-04T12:22:46.901-0400 W REPL [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source cannot be behind me, and if I am up-to-date with the sync source, it must have a higher lastOpCommitted. My last fetched oplog optime: { ts: Timestamp(1538669483, 1), t: 1 }, latest oplog optime of sync source: { ts: Timestamp(1538669483, 1), t: 1 }, my lastOpCommitted: { ts: Timestamp(1538669483, 1), t: 1 }, lastOpCommitted of sync source: { ts: Timestamp(1538669483, 1), t: 1 } 2018-10-04T12:22:46.902-0400 I REPL [rsBackgroundSync] Clearing sync source jazzstep-2.local:9007 to choose a new one. 2018-10-04T12:22:46.903-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T12:22:46.909-0400 I REPL [replexec-6] VoteRequester(term 2) received a yes vote from jazzstep-2.local:9007; response message: { term: 2, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538669483, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('7fffffff0000000000000001') }, lastCommittedOpTime: Timestamp(1538669483, 1), $clusterTime: { clusterTime: Timestamp(1538669483, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:22:46.916-0400 I REPL [replexec-10] election succeeded, assuming primary role in term 2 2018-10-04T12:22:46.918-0400 I REPL [replexec-10] transition to PRIMARY from SECONDARY 2018-10-04T12:22:46.919-0400 I REPL [replexec-10] Resetting sync source to empty, which was :27017 2018-10-04T12:22:46.921-0400 I REPL [replexec-10] Entering primary catch-up mode. 2018-10-04T12:22:46.922-0400 I REPL [replexec-10] Caught up to the latest optime known via heartbeats after becoming primary. 2018-10-04T12:22:46.923-0400 I REPL [replexec-10] Exited primary catch-up mode. 2018-10-04T12:22:46.923-0400 I REPL [replexec-10] Stopping replication producer 2018-10-04T12:22:47.978-0400 I SHARDING [Balancer] CSRS balancer is starting 2018-10-04T12:22:47.979-0400 I REPL [rsSync-0] transition to primary complete; database writes are now permitted 2018-10-04T12:22:47.982-0400 I SHARDING [Balancer] CSRS balancer thread is recovering 2018-10-04T12:22:47.983-0400 I SHARDING [Balancer] CSRS balancer thread is recovered 2018-10-04T12:22:50.101-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62670 #41 (9 connections now open) 2018-10-04T12:22:50.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:50.102-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62672 #42 (10 connections now open) 2018-10-04T12:22:50.102-0400 I NETWORK [conn41] received client metadata from 10.1.25.36:62670 conn41: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.104-0400 I NETWORK [conn42] received client metadata from 10.1.25.36:62672 conn42: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.106-0400 I NETWORK [conn23] end connection 10.1.25.36:58973 (9 connections now open) 2018-10-04T12:22:50.115-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62681 #43 (10 connections now open) 2018-10-04T12:22:50.117-0400 I NETWORK [conn43] received client metadata from 10.1.25.36:62681 conn43: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.117-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62682 #44 (11 connections now open) 2018-10-04T12:22:50.121-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62684 #45 (12 connections now open) 2018-10-04T12:22:50.121-0400 I NETWORK [conn44] received client metadata from 10.1.25.36:62682 conn44: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.125-0400 I NETWORK [conn45] received client metadata from 10.1.25.36:62684 conn45: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.606-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:51.111-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:51.620-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:51.901-0400 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update to jazzstep-2.local:9007: InvalidSyncSource: Sync source was cleared. Was jazzstep-2.local:9007 2018-10-04T12:22:52.132-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:52.650-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:53.167-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:53.682-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:54.201-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:54.643-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:22:54.668-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 705885ms ms 2018-10-04T12:22:54.680-0400 I SHARDING [replSetDistLockPinger] distributed lock with ts: 5bb63b423d8f72c85d19095e and _id: config unlocked. 2018-10-04T12:22:54.709-0400 I SHARDING [replSetDistLockPinger] distributed lock with ts: 5bb638ea3d8f72c85d190629 and _id: config unlocked. 2018-10-04T12:22:54.719-0400 I SHARDING [replSetDistLockPinger] distributed lock with ts: 5bb63a163d8f72c85d1907c4 and _id: config unlocked. 2018-10-04T12:22:54.724-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:55.242-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:55.760-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:56.280-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:56.793-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:56.914-0400 I ASIO [Replication] Ending connection to host jazzstep-2.local:9009 due to bad connection status; 1 connections to that host remain open 2018-10-04T12:22:57.309-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:57.828-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:58.349-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:58.870-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:59.393-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:59.913-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:00.431-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:00.952-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:01.470-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:01.984-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:02.500-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:03.018-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:03.531-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:04.034-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:04.537-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:05.040-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:05.544-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:06.048-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:06.556-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:07.067-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:07.577-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:08.080-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:08.080-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:23:08.081-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:23:08.081-0400-5bb63e6c3d8f72c85d190a89", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670188081), what: "balancer.round", ns: "", details: { executionTimeMillis: 20097, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:23:18.107-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:18.610-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:19.113-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:19.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:20.125-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:20.631-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:21.134-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:21.640-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:22.142-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:22.645-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:23.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:23.654-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:24.156-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:24.651-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:23:24.660-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:25.163-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:25.667-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:26.170-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:26.682-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:27.184-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:27.687-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:28.189-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:28.692-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:29.196-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:29.701-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:30.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:30.715-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:31.218-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:31.722-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:32.225-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:32.737-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:33.241-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:33.743-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:34.247-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:34.753-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:35.255-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:35.764-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:36.267-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:36.771-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:37.274-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:37.780-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:38.283-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:23:38.284-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:23:38.285-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:23:38.285-0400-5bb63e8a3d8f72c85d190b00", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670218285), what: "balancer.round", ns: "", details: { executionTimeMillis: 20180, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:30:01.968-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:01.969-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9007 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:01.970-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9009 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:01.972-0400 I NETWORK [conn41] end connection 10.1.25.36:62670 (11 connections now open) 2018-10-04T12:30:01.973-0400 I REPL [replexec-11] Member jazzstep-2.local:9007 is now in state RS_DOWN 2018-10-04T12:30:01.974-0400 I REPL [replexec-11] Member jazzstep-2.local:9009 is now in state RS_DOWN 2018-10-04T12:30:01.975-0400 I NETWORK [conn42] end connection 10.1.25.36:62672 (10 connections now open) 2018-10-04T12:30:01.975-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:30:01.977-0400 I REPL [replexec-11] can't see a majority of the set, relinquishing primary 2018-10-04T12:30:01.978-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T12:30:01.978-0400 I NETWORK [conn44] end connection 10.1.25.36:62682 (9 connections now open) 2018-10-04T12:30:01.979-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63664 #46 (10 connections now open) 2018-10-04T12:30:01.979-0400 I REPL [replexec-11] Stepping down from primary in response to heartbeat 2018-10-04T12:30:01.979-0400 I NETWORK [conn43] end connection 10.1.25.36:62681 (9 connections now open) 2018-10-04T12:30:01.979-0400 I NETWORK [conn32] end connection 127.0.0.1:62630 (8 connections now open) 2018-10-04T12:30:01.982-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63665 #49 (9 connections now open) 2018-10-04T12:30:01.982-0400 I NETWORK [conn46] received client metadata from 10.1.25.36:63664 conn46: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.983-0400 I REPL [replexec-8] Member jazzstep-2.local:9009 is now in state SECONDARY 2018-10-04T12:30:01.985-0400 I NETWORK [conn49] received client metadata from 10.1.25.36:63665 conn49: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.987-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63673 #50 (10 connections now open) 2018-10-04T12:30:01.988-0400 I REPL [replexec-7] transition to SECONDARY from PRIMARY 2018-10-04T12:30:01.989-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63674 #51 (11 connections now open) 2018-10-04T12:30:01.989-0400 I NETWORK [conn50] received client metadata from 10.1.25.36:63673 conn50: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.991-0400 I NETWORK [replexec-7] Skip closing connection for connection # 51 2018-10-04T12:30:01.991-0400 I REPL [replexec-10] Member jazzstep-2.local:9007 is now in state SECONDARY 2018-10-04T12:30:01.991-0400 I NETWORK [conn51] received client metadata from 10.1.25.36:63674 conn51: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.992-0400 I NETWORK [replexec-7] Skip closing connection for connection # 50 2018-10-04T12:30:01.995-0400 I NETWORK [replexec-7] Skip closing connection for connection # 49 2018-10-04T12:30:01.996-0400 I NETWORK [replexec-7] Skip closing connection for connection # 46 2018-10-04T12:30:01.996-0400 I NETWORK [replexec-7] Skip closing connection for connection # 45 2018-10-04T12:30:01.997-0400 I NETWORK [replexec-7] Skip closing connection for connection # 40 2018-10-04T12:30:01.997-0400 I NETWORK [replexec-7] Skip closing connection for connection # 38 2018-10-04T12:30:01.998-0400 I NETWORK [replexec-7] Skip closing connection for connection # 30 2018-10-04T12:30:01.998-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63676 #52 (12 connections now open) 2018-10-04T12:30:01.998-0400 I NETWORK [conn31] end connection 10.1.25.36:49308 (11 connections now open) 2018-10-04T12:30:01.998-0400 I NETWORK [conn26] end connection 10.1.25.36:58996 (10 connections now open) 2018-10-04T12:30:01.998-0400 I NETWORK [conn22] end connection 10.1.25.36:58970 (9 connections now open) 2018-10-04T12:30:01.998-0400 I SHARDING [Balancer] CSRS balancer is now stopped 2018-10-04T12:30:01.999-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63679 #53 (10 connections now open) 2018-10-04T12:30:01.999-0400 I NETWORK [conn52] received client metadata from 10.1.25.36:63676 conn52: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:02.003-0400 I NETWORK [conn38] end connection 127.0.0.1:62640 (9 connections now open) 2018-10-04T12:30:02.004-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63685 #54 (10 connections now open) 2018-10-04T12:30:02.004-0400 I NETWORK [conn53] received client metadata from 10.1.25.36:63679 conn53: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:02.005-0400 I NETWORK [conn40] end connection 127.0.0.1:62649 (9 connections now open) 2018-10-04T12:30:02.006-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63686 #55 (10 connections now open) 2018-10-04T12:30:02.007-0400 I NETWORK [conn54] received client metadata from 10.1.25.36:63685 conn54: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:02.009-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63687 #56 (11 connections now open) 2018-10-04T12:30:02.009-0400 I NETWORK [conn55] received client metadata from 10.1.25.36:63686 conn55: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:02.010-0400 I NETWORK [conn56] received client metadata from 10.1.25.36:63687 conn56: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:02.492-0400 I REPL [replexec-8] Member jazzstep-2.local:9007 is now in state PRIMARY 2018-10-04T12:30:02.949-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:02.950-0400 I ASIO [RS] Dropping all pooled connections to jazzstep-2.local:9007 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:03.431-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63766 #57 (12 connections now open) 2018-10-04T12:30:03.432-0400 I NETWORK [conn57] received client metadata from 10.1.25.36:63766 conn57: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.090-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9007 2018-10-04T12:30:04.091-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:30:04.106-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9007 2018-10-04T12:30:04.107-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:30:07.035-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63837 #60 (13 connections now open) 2018-10-04T12:30:07.035-0400 I NETWORK [conn60] received client metadata from 10.1.25.36:63837 conn60: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:07.807-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:07.886-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 403146ms ms 2018-10-04T12:30:19.231-0400 I NETWORK [listener] connection accepted from 10.1.25.36:64077 #61 (14 connections now open) 2018-10-04T12:30:19.232-0400 I NETWORK [conn61] received client metadata from 10.1.25.36:64077 conn61: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:19.246-0400 I NETWORK [conn30] end connection 10.1.25.36:60569 (13 connections now open) 2018-10-04T12:30:37.837-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:01.997-0400 I NETWORK [conn49] end connection 10.1.25.36:63665 (12 connections now open) 2018-10-04T12:31:02.010-0400 I NETWORK [conn52] end connection 10.1.25.36:63676 (11 connections now open) 2018-10-04T12:31:02.011-0400 I NETWORK [conn53] end connection 10.1.25.36:63679 (10 connections now open) 2018-10-04T12:31:02.012-0400 I NETWORK [conn55] end connection 10.1.25.36:63686 (9 connections now open) 2018-10-04T12:31:02.028-0400 I NETWORK [conn51] end connection 10.1.25.36:63674 (8 connections now open) 2018-10-04T12:31:07.845-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:37.848-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:07.758-0400 I SH_REFR [ConfigServerCatalogCacheLoader-3] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:32:07.759-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:32:07.760-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:07.851-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:07.924-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb640873d8f72c85d190be3 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:37.858-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:37.926-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb640873d8f72c85d190be3 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:07.919-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:07.927-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb640873d8f72c85d190be3 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:19.282-0400 I NETWORK [listener] connection accepted from 10.1.25.36:50997 #62 (9 connections now open) 2018-10-04T12:33:19.283-0400 I NETWORK [conn62] received client metadata from 10.1.25.36:50997 conn62: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:33:37.923-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:37.929-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb640873d8f72c85d190be3 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:34:07.928-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:34:07.930-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb640873d8f72c85d190be3 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks