2018-10-04T11:54:38.824-0400 I CONTROL [initandlisten] MongoDB starting : pid=23305 port=9009 dbpath=/tmp/mms-automation/test/output/data/process9009 64-bit host=jazzstep-2.local 2018-10-04T11:54:38.824-0400 I CONTROL [initandlisten] db version v4.0.3-rc0 2018-10-04T11:54:38.825-0400 I CONTROL [initandlisten] git version: 7ea530946fa7880364d88c8d8b6026bbc9ffa48c 2018-10-04T11:54:38.825-0400 I CONTROL [initandlisten] allocator: system 2018-10-04T11:54:38.826-0400 I CONTROL [initandlisten] modules: none 2018-10-04T11:54:38.826-0400 I CONTROL [initandlisten] build environment: 2018-10-04T11:54:38.826-0400 I CONTROL [initandlisten] distarch: x86_64 2018-10-04T11:54:38.827-0400 I CONTROL [initandlisten] target_arch: x86_64 2018-10-04T11:54:38.827-0400 I CONTROL [initandlisten] options: { config: "/tmp/mms-automation/test/output/data/process9009/automation-mongod.conf", net: { bindIp: "0.0.0.0", port: 9009 }, processManagement: { fork: true }, replication: { oplogSizeMB: 64, replSetName: "csrs" }, sharding: { clusterRole: "configsvr" }, storage: { dbPath: "/tmp/mms-automation/test/output/data/process9009", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", path: "/tmp/mms-automation/test/logs/run9009" } } 2018-10-04T11:54:38.828-0400 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress), 2018-10-04T11:54:39.339-0400 I STORAGE [initandlisten] WiredTiger message [1538668479:339126][23305:0x7fff8d0db380], txn-recover: Set global recovery timestamp: 0 2018-10-04T11:54:39.364-0400 I RECOVERY [initandlisten] WiredTiger recoveryTimestamp. Ts: Timestamp(0, 0) 2018-10-04T11:54:39.411-0400 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2018-10-04T11:54:39.412-0400 I CONTROL [initandlisten] 2018-10-04T11:54:39.412-0400 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-10-04T11:54:39.413-0400 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-10-04T11:54:39.414-0400 I CONTROL [initandlisten] 2018-10-04T11:54:39.422-0400 I STORAGE [initandlisten] createCollection: local.startup_log with generated UUID: 3b55cfef-8769-4c4e-91f7-76850074bd2b 2018-10-04T11:54:39.461-0400 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/tmp/mms-automation/test/output/data/process9009/diagnostic.data' 2018-10-04T11:54:39.468-0400 I SHARDING [thread1] creating distributed lock ping thread for process ConfigServer (sleeping for 30000ms) 2018-10-04T11:54:39.468-0400 I SHARDING [shard registry reload] Periodic reload of shard registry failed :: caused by :: ReadConcernMajorityNotAvailableYet: could not get updated shard list from config server :: caused by :: Read concern majority reads are currently not possible.; will retry after 30s 2018-10-04T11:54:39.468-0400 I STORAGE [initandlisten] createCollection: local.replset.oplogTruncateAfterPoint with generated UUID: 30390ecf-cac4-4f09-8ffa-cdf62173546d 2018-10-04T11:54:39.517-0400 I STORAGE [initandlisten] createCollection: local.replset.minvalid with generated UUID: 9e7881ac-8f36-46f7-9dc3-64782329f53a 2018-10-04T11:54:39.559-0400 I REPL [initandlisten] Did not find local voted for document at startup. 2018-10-04T11:54:39.560-0400 I REPL [initandlisten] Did not find local Rollback ID document at startup. Creating one. 2018-10-04T11:54:39.561-0400 I STORAGE [initandlisten] createCollection: local.system.rollback.id with generated UUID: bf524d91-bcc3-4480-b8e2-78e787c384d4 2018-10-04T11:54:39.595-0400 I REPL [initandlisten] Initialized the rollback ID to 1 2018-10-04T11:54:39.596-0400 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2018-10-04T11:54:39.597-0400 I NETWORK [initandlisten] waiting for connections on port 9009 2018-10-04T11:54:39.597-0400 I SH_REFR [ConfigServerCatalogCacheLoader-0] Refresh for database config took 0 ms and found { _id: "config", primary: "config", partitioned: true } 2018-10-04T11:54:39.598-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Cannot create config.system.sessions until there are shards, will try again at the next refresh interval 2018-10-04T11:54:39.599-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Cannot create config.system.sessions until there are shards 2018-10-04T11:54:39.619-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58850 #1 (1 connection now open) 2018-10-04T11:54:39.620-0400 I ACCESS [conn1] SASL SCRAM-SHA-1 authentication failed for __system on local from client 10.1.25.36:58850 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:39.620-0400 I NETWORK [conn1] end connection 10.1.25.36:58850 (0 connections now open) 2018-10-04T11:54:39.621-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58851 #2 (1 connection now open) 2018-10-04T11:54:39.622-0400 I ACCESS [conn2] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:39.623-0400 I ACCESS [conn2] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 10.1.25.36:58851 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:39.623-0400 I NETWORK [conn2] end connection 10.1.25.36:58851 (0 connections now open) 2018-10-04T11:54:39.625-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58852 #3 (1 connection now open) 2018-10-04T11:54:39.634-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58857 #4 (2 connections now open) 2018-10-04T11:54:39.635-0400 I NETWORK [conn4] end connection 10.1.25.36:58857 (1 connection now open) 2018-10-04T11:54:39.637-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58859 #5 (2 connections now open) 2018-10-04T11:54:39.638-0400 I NETWORK [conn5] received client metadata from 10.1.25.36:58859 conn5: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:39.639-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:41.658-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58863 #7 (3 connections now open) 2018-10-04T11:54:41.659-0400 I NETWORK [conn7] end connection 10.1.25.36:58863 (2 connections now open) 2018-10-04T11:54:41.661-0400 I STORAGE [replexec-0] createCollection: local.system.replset with generated UUID: b29c5df9-fd91-43e2-ab40-2c8d2ed6fbfe 2018-10-04T11:54:41.720-0400 I REPL [replexec-0] New replica set config in use: { _id: "csrs", version: 1, configsvr: true, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "jazzstep-2.local:9007", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "jazzstep-2.local:9008", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "jazzstep-2.local:9009", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('5bb637bf290d7fa45d18bef1') } } 2018-10-04T11:54:41.721-0400 I REPL [replexec-0] This node is jazzstep-2.local:9009 in the config 2018-10-04T11:54:41.722-0400 I REPL [replexec-0] transition to STARTUP2 from STARTUP 2018-10-04T11:54:41.723-0400 I REPL [replexec-0] Starting replication storage threads 2018-10-04T11:54:41.723-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T11:54:41.724-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58866 #10 (3 connections now open) 2018-10-04T11:54:41.725-0400 I REPL [replexec-1] Member jazzstep-2.local:9007 is now in state SECONDARY 2018-10-04T11:54:41.728-0400 I NETWORK [conn10] received client metadata from 10.1.25.36:58866 conn10: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:41.731-0400 I REPL [replexec-2] Member jazzstep-2.local:9008 is now in state STARTUP2 2018-10-04T11:54:41.747-0400 I STORAGE [replexec-0] createCollection: local.temp_oplog_buffer with generated UUID: 22ece3a4-9277-4f3b-8c9b-6f70f271058e 2018-10-04T11:54:41.807-0400 I REPL [replication-0] Starting initial sync (attempt 1 of 10) 2018-10-04T11:54:41.809-0400 I STORAGE [replication-0] Finishing collection drop for local.temp_oplog_buffer (22ece3a4-9277-4f3b-8c9b-6f70f271058e). 2018-10-04T11:54:41.830-0400 I STORAGE [replication-0] createCollection: local.temp_oplog_buffer with generated UUID: e6bbce29-4616-450f-a32b-6d988fa2b424 2018-10-04T11:54:41.889-0400 I REPL [replication-0] sync source candidate: jazzstep-2.local:9007 2018-10-04T11:54:41.893-0400 I REPL [replication-0] Initial syncer oplog truncation finished in: 0ms 2018-10-04T11:54:41.893-0400 I REPL [replication-0] ****** 2018-10-04T11:54:41.894-0400 I REPL [replication-0] creating replication oplog of size: 64MB... 2018-10-04T11:54:41.895-0400 I STORAGE [replication-0] createCollection: local.oplog.rs with generated UUID: 1f83cb6a-bc19-4971-bcb9-44967e7895b0 2018-10-04T11:54:41.934-0400 I STORAGE [replication-0] Starting OplogTruncaterThread local.oplog.rs 2018-10-04T11:54:41.935-0400 I STORAGE [replication-0] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2018-10-04T11:54:41.936-0400 I STORAGE [replication-0] Scanning the oplog to determine where to place markers for truncation 2018-10-04T11:54:42.134-0400 I REPL [replication-0] ****** 2018-10-04T11:54:42.136-0400 I STORAGE [replication-0] dropAllDatabasesExceptLocal 1 2018-10-04T11:54:42.138-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:42.156-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:42.157-0400 I REPL [replication-1] CollectionCloner::start called, on ns:admin.system.version 2018-10-04T11:54:42.165-0400 I STORAGE [repl writer worker 0] createCollection: admin.system.version with provided UUID: e7fcf9ad-9db8-444c-8c5f-7916f7ba4aba 2018-10-04T11:54:42.211-0400 I INDEX [repl writer worker 0] build index on: admin.system.version properties: { v: 2, key: { _id: 1 }, name: "_id_", ns: "admin.system.version" } 2018-10-04T11:54:42.212-0400 I INDEX [repl writer worker 0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:42.216-0400 I COMMAND [repl writer worker 1] setting featureCompatibilityVersion to 4.0 2018-10-04T11:54:42.220-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 10 2018-10-04T11:54:42.220-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 5 2018-10-04T11:54:42.227-0400 I NETWORK [repl writer worker 1] Skip closing connection for connection # 3 2018-10-04T11:54:42.228-0400 I REPL [repl writer worker 1] CollectionCloner ns:admin.system.version finished cloning with status: OK 2018-10-04T11:54:42.233-0400 I REPL [repl writer worker 1] Finished cloning data: OK. Beginning oplog replay. 2018-10-04T11:54:42.236-0400 I REPL [replication-1] No need to apply operations. (currently at { : Timestamp(1538668479, 1) }) 2018-10-04T11:54:42.237-0400 I REPL [replexec-0] Member jazzstep-2.local:9008 is now in state RECOVERING 2018-10-04T11:54:42.240-0400 I REPL [replication-0] Finished fetching oplog during initial sync: CallbackCanceled: error in fetcher batch callback: oplog fetcher is shutting down. Last fetched optime and hash: { ts: Timestamp(0, 0), t: -1 }[0] 2018-10-04T11:54:42.241-0400 I REPL [replication-0] Initial sync attempt finishing up. 2018-10-04T11:54:42.242-0400 I REPL [replication-0] Initial Sync Attempt Statistics: { failedInitialSyncAttempts: 0, maxFailedInitialSyncAttempts: 10, initialSyncStart: new Date(1538668481807), initialSyncAttempts: [], fetchedMissingDocs: 0, appliedOps: 0, initialSyncOplogStart: Timestamp(1538668479, 1), initialSyncOplogEnd: Timestamp(1538668479, 1), databases: { databasesCloned: 1, admin: { collections: 1, clonedCollections: 1, start: new Date(1538668482157), end: new Date(1538668482236), elapsedMillis: 79, admin.system.version: { documentsToCopy: 1, documentsCopied: 1, indexes: 1, fetchedBatches: 1, start: new Date(1538668482158), end: new Date(1538668482236), elapsedMillis: 78 } } } } 2018-10-04T11:54:42.243-0400 I STORAGE [replication-0] Finishing collection drop for local.temp_oplog_buffer (e6bbce29-4616-450f-a32b-6d988fa2b424). 2018-10-04T11:54:42.261-0400 I REPL [replication-0] initial sync done; took 0s. 2018-10-04T11:54:42.265-0400 I REPL [replication-0] transition to RECOVERING from STARTUP2 2018-10-04T11:54:42.267-0400 I REPL [replication-0] Starting replication fetcher thread 2018-10-04T11:54:42.267-0400 I REPL [replication-0] Starting replication applier thread 2018-10-04T11:54:42.268-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T11:54:42.268-0400 I REPL [replication-0] Starting replication reporter thread 2018-10-04T11:54:42.268-0400 I REPL [rsSync-0] Starting oplog application 2018-10-04T11:54:42.271-0400 I REPL [replexec-2] Member jazzstep-2.local:9008 is now in state SECONDARY 2018-10-04T11:54:42.272-0400 I REPL [rsSync-0] transition to SECONDARY from RECOVERING 2018-10-04T11:54:42.272-0400 I REPL [rsSync-0] Resetting sync source to empty, which was :27017 2018-10-04T11:54:50.978-0400 I STORAGE [conn5] createCollection: local.replset.election with generated UUID: af89f1fe-6fbb-4d16-a404-f3d12c5b6d95 2018-10-04T11:54:51.302-0400 I REPL [replexec-2] Member jazzstep-2.local:9007 is now in state PRIMARY 2018-10-04T11:54:52.157-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9007 due to bad connection status; 1 connections to that host remain open 2018-10-04T11:54:53.882-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58876 #14 (4 connections now open) 2018-10-04T11:54:53.884-0400 I ACCESS [conn14] SASL SCRAM-SHA-1 authentication failed for __system on local from client 127.0.0.1:58876 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:53.885-0400 I NETWORK [conn14] end connection 127.0.0.1:58876 (3 connections now open) 2018-10-04T11:54:53.885-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58877 #15 (4 connections now open) 2018-10-04T11:54:53.887-0400 I ACCESS [conn15] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:53.888-0400 I ACCESS [conn15] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 127.0.0.1:58877 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:53.890-0400 I NETWORK [conn15] end connection 127.0.0.1:58877 (3 connections now open) 2018-10-04T11:54:53.891-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58878 #16 (4 connections now open) 2018-10-04T11:54:54.295-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9007 2018-10-04T11:54:54.300-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9007 2018-10-04T11:54:54.302-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T11:54:54.305-0400 I STORAGE [replication-0] Triggering the first stable checkpoint. Initial Data: Timestamp(1538668479, 1) PrevStable: Timestamp(0, 0) CurrStable: Timestamp(1538668479, 1) 2018-10-04T11:54:54.312-0400 I STORAGE [repl writer worker 5] createCollection: config.chunks with provided UUID: 4acf8dfb-4484-4099-9f1f-ef02aa9c289f 2018-10-04T11:54:54.627-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58883 #18 (5 connections now open) 2018-10-04T11:54:54.648-0400 I COMMAND [monitoring keys for HMAC] command admin.system.keys command: find { find: "system.keys", filter: { purpose: "HMAC", expiresAt: { $gt: Timestamp(0, 0) } }, sort: { expiresAt: 1 }, $readPreference: { mode: "nearest", tags: [] }, $db: "admin" } planSummary: EOF keysExamined:0 docsExamined:0 cursorExhausted:1 numYields:0 nreturned:0 reslen:320 locks:{ Global: { acquireCount: { r: 1 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 304892 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { r: 1 } } } protocol:op_msg 305ms 2018-10-04T11:54:54.682-0400 I INDEX [repl writer worker 9] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:54.683-0400 I INDEX [repl writer worker 9] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.693-0400 I INDEX [repl writer worker 9] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.751-0400 I INDEX [repl writer worker 12] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, shard: 1, min: 1 }, name: "ns_1_shard_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:54.755-0400 I INDEX [repl writer worker 12] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.764-0400 I INDEX [repl writer worker 12] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.820-0400 I INDEX [repl writer worker 1] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, lastmod: 1 }, name: "ns_1_lastmod_1", ns: "config.chunks" } 2018-10-04T11:54:54.821-0400 I INDEX [repl writer worker 1] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.836-0400 I INDEX [repl writer worker 1] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.843-0400 I STORAGE [repl writer worker 2] createCollection: config.migrations with provided UUID: 2c153a2c-409d-4354-af8d-2da4c3dbabcb 2018-10-04T11:54:54.951-0400 I INDEX [repl writer worker 7] build index on: config.migrations properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.migrations" } 2018-10-04T11:54:54.952-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:54.956-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:54.958-0400 I STORAGE [repl writer worker 9] createCollection: config.shards with provided UUID: 83541a41-5a83-4aaf-82e6-75a98c3b8535 2018-10-04T11:54:55.071-0400 I INDEX [repl writer worker 12] build index on: config.shards properties: { v: 2, unique: true, key: { host: 1 }, name: "host_1", ns: "config.shards" } 2018-10-04T11:54:55.072-0400 I INDEX [repl writer worker 12] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.076-0400 I INDEX [repl writer worker 12] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.078-0400 I STORAGE [repl writer worker 15] createCollection: config.locks with provided UUID: 9cd77010-8190-4320-9dc5-4063826f18a2 2018-10-04T11:54:55.173-0400 I INDEX [repl writer worker 2] build index on: config.locks properties: { v: 2, key: { ts: 1 }, name: "ts_1", ns: "config.locks" } 2018-10-04T11:54:55.173-0400 I INDEX [repl writer worker 2] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.181-0400 I INDEX [repl writer worker 2] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.235-0400 I INDEX [repl writer worker 7] build index on: config.locks properties: { v: 2, key: { state: 1, process: 1 }, name: "state_1_process_1", ns: "config.locks" } 2018-10-04T11:54:55.238-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.251-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.253-0400 I STORAGE [repl writer worker 9] createCollection: config.lockpings with provided UUID: 96955f75-9ab8-4b7a-9866-f90df07eda5e 2018-10-04T11:54:55.359-0400 I INDEX [repl writer worker 12] build index on: config.lockpings properties: { v: 2, key: { ping: 1 }, name: "ping_1", ns: "config.lockpings" } 2018-10-04T11:54:55.359-0400 I INDEX [repl writer worker 12] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.372-0400 I INDEX [repl writer worker 12] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.378-0400 I STORAGE [repl writer worker 15] createCollection: config.tags with provided UUID: 5c9b63ea-58bf-4bf6-b6f7-43dc7c12ac98 2018-10-04T11:54:55.482-0400 I INDEX [repl writer worker 2] build index on: config.tags properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.tags" } 2018-10-04T11:54:55.483-0400 I INDEX [repl writer worker 2] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.487-0400 I INDEX [repl writer worker 2] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.560-0400 I INDEX [repl writer worker 7] build index on: config.tags properties: { v: 2, key: { ns: 1, tag: 1 }, name: "ns_1_tag_1", ns: "config.tags" } 2018-10-04T11:54:55.563-0400 I INDEX [repl writer worker 7] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:55.572-0400 I INDEX [repl writer worker 7] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:55.574-0400 I STORAGE [repl writer worker 9] createCollection: config.version with provided UUID: 4653338a-2d1f-4b0d-be38-d33757459d0b 2018-10-04T11:54:55.682-0400 I STORAGE [repl writer worker 12] createCollection: config.transactions with provided UUID: 7e00fbae-25f1-43a1-a523-94d4c94e331a 2018-10-04T11:54:55.765-0400 I STORAGE [repl writer worker 15] createCollection: admin.system.keys with provided UUID: 62bf9df9-59de-4f87-9f5e-10442108a0e0 2018-10-04T11:55:08.896-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58933 #19 (6 connections now open) 2018-10-04T11:55:19.954-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58968 #20 (7 connections now open) 2018-10-04T11:55:19.954-0400 I NETWORK [conn20] received client metadata from 10.1.25.36:58968 conn20: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.968-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58975 #21 (8 connections now open) 2018-10-04T11:55:19.973-0400 I NETWORK [conn21] received client metadata from 10.1.25.36:58975 conn21: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.017-0400 I STORAGE [repl writer worker 9] createCollection: config.mongos with provided UUID: a968e6e5-dc3c-4cad-b545-d2e970cbad2b 2018-10-04T11:55:20.131-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58989 #22 (9 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58991 #23 (10 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [conn22] received client metadata from 10.1.25.36:58989 conn22: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.133-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58995 #24 (11 connections now open) 2018-10-04T11:55:20.133-0400 I NETWORK [conn23] received client metadata from 10.1.25.36:58991 conn23: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.137-0400 I NETWORK [conn24] received client metadata from 10.1.25.36:58995 conn24: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.160-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59002 #25 (12 connections now open) 2018-10-04T11:55:20.161-0400 I NETWORK [conn25] received client metadata from 10.1.25.36:59002 conn25: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.176-0400 I NETWORK [conn25] end connection 10.1.25.36:59002 (11 connections now open) 2018-10-04T11:55:20.185-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59007 #26 (12 connections now open) 2018-10-04T11:55:20.186-0400 I NETWORK [conn26] received client metadata from 10.1.25.36:59007 conn26: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.260-0400 I STORAGE [repl writer worker 1] createCollection: config.changelog with provided UUID: 42c8c7b6-7f0a-4c5f-9b62-509e01fed92f 2018-10-04T11:55:20.417-0400 I STORAGE [repl writer worker 9] createCollection: config.databases with provided UUID: fe6cb2e2-5c5f-4138-a534-6174c0056936 2018-10-04T11:55:20.635-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59032 #27 (13 connections now open) 2018-10-04T11:55:20.638-0400 I NETWORK [conn27] received client metadata from 10.1.25.36:59032 conn27: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.786-0400 I NETWORK [conn27] end connection 10.1.25.36:59032 (12 connections now open) 2018-10-04T11:55:20.787-0400 I NETWORK [conn23] end connection 10.1.25.36:58991 (11 connections now open) 2018-10-04T11:55:33.968-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59306 #28 (12 connections now open) 2018-10-04T11:55:33.968-0400 I NETWORK [conn28] received client metadata from 10.1.25.36:59306 conn28: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:34.009-0400 I NETWORK [conn28] end connection 10.1.25.36:59306 (11 connections now open) 2018-10-04T11:55:34.009-0400 I NETWORK [conn22] end connection 10.1.25.36:58989 (10 connections now open) 2018-10-04T11:55:39.481-0400 I NETWORK [shard registry reload] Starting new replica set monitor for foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 2018-10-04T11:55:39.487-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9002 (1 connections now open to jazzstep-2.local:9002 with a 5 second timeout) 2018-10-04T11:55:39.488-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:04.252-0400 I STORAGE [repl writer worker 11] createCollection: config.actionlog with provided UUID: c5416714-1761-4e21-a2d0-8b64bb1c0cfc 2018-10-04T11:56:09.496-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:39.499-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:09.504-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:39.511-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:09.515-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:39.521-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:09.526-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:38.008-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49310 #30 (11 connections now open) 2018-10-04T11:59:38.009-0400 I NETWORK [conn30] received client metadata from 10.1.25.36:49310 conn30: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:59:39.529-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:39.600-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T11:59:39.600-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:07.078-0400 I NETWORK [conn3] end connection 10.1.25.36:58852 (10 connections now open) 2018-10-04T12:00:07.078-0400 I NETWORK [conn18] end connection 10.1.25.36:58883 (9 connections now open) 2018-10-04T12:00:07.079-0400 I NETWORK [conn16] end connection 127.0.0.1:58878 (8 connections now open) 2018-10-04T12:00:07.079-0400 I NETWORK [conn19] end connection 127.0.0.1:58933 (7 connections now open) 2018-10-04T12:00:09.514-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:09.532-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:00:39.516-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:00:39.535-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:09.521-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:01:09.539-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:39.526-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:01:39.544-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:09.528-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:02:09.547-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:39.534-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:02:39.552-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:09.536-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:03:09.555-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:39.540-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:03:39.560-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:09.545-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:04:09.562-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:39.547-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:04:39.564-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:39.602-0400 I SH_REFR [ConfigServerCatalogCacheLoader-1] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:04:39.603-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:04:39.603-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:09.550-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:09.551-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:09.569-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:05:39.557-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:39.561-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:05:39.571-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:09.563-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:09.564-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:09.575-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:39.572-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:06:39.577-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:39.578-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:09.580-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:09.580-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:09.580-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:39.582-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:39.587-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:07:39.592-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:09.587-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:09.594-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:09.595-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:39.590-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:39.600-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:08:39.618-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:09.591-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:09.620-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:09.620-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:39.593-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:39.604-0400 I SH_REFR [ConfigServerCatalogCacheLoader-2] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:09:39.608-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:09:39.612-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:39.623-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:39.625-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:09:39.626-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:09.596-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:09.631-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:09.632-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:09.632-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:39.601-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:39.638-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:39.643-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:10:39.644-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:09.604-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:11:09.645-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:09.646-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:11:09.647-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:22:44.969-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9007 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:44.973-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:22:44.973-0400 I REPL [replication-0] Restarting oplog query due to error: NetworkInterfaceExceededTimeLimit: error in fetcher batch callback :: caused by :: timed out. Last fetched optime (with hash): { ts: Timestamp(1538669483, 1), t: 1 }[3376758897828916176]. Restarts remaining: 1 2018-10-04T12:22:44.974-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9008 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:44.976-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9007 due to bad connection status; 0 connections to that host remain open 2018-10-04T12:22:44.977-0400 I NETWORK [conn5] end connection 10.1.25.36:58859 (6 connections now open) 2018-10-04T12:22:44.978-0400 I REPL [replication-0] Scheduled new oplog query Fetcher source: jazzstep-2.local:9007 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538669483, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1538669483, 1) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 7000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 2425 -- target:jazzstep-2.local:9007 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538669483, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 1, readConcern: { afterClusterTime: Timestamp(1538669483, 1) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms 2018-10-04T12:22:44.981-0400 I REPL [replexec-7] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-10-04T12:22:44.981-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.981-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.985-0400 I REPL [replexec-7] conducting a dry run election to see if we could be elected. current term: 1 2018-10-04T12:22:44.986-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.987-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:44.989-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9007 2018-10-04T12:22:44.990-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:45.021-0400 I NETWORK [conn10] end connection 10.1.25.36:58866 (5 connections now open) 2018-10-04T12:22:46.891-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62637 #35 (6 connections now open) 2018-10-04T12:22:46.892-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62642 #37 (7 connections now open) 2018-10-04T12:22:46.892-0400 I NETWORK [conn35] received client metadata from 127.0.0.1:62637 conn35: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.893-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62648 #39 (8 connections now open) 2018-10-04T12:22:46.894-0400 I NETWORK [conn37] received client metadata from 127.0.0.1:62642 conn37: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.895-0400 I NETWORK [conn39] received client metadata from 127.0.0.1:62648 conn39: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.899-0400 I REPL [replexec-10] VoteRequester(term 1 dry run) received a no vote from jazzstep-2.local:9008 with reason "candidate's term (1) is lower than mine (2)"; response message: { term: 2, voteGranted: false, reason: "candidate's term (1) is lower than mine (2)", ok: 1.0, operationTime: Timestamp(1538669483, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('000000000000000000000000') }, lastCommittedOpTime: Timestamp(1538669483, 1), $clusterTime: { clusterTime: Timestamp(1538669483, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:22:46.901-0400 I REPL [replexec-7] Member jazzstep-2.local:9007 is now in state SECONDARY 2018-10-04T12:22:46.910-0400 I REPL [replexec-10] not running for primary, we have been superseded already during dry run. original term: 1, current term: 2 2018-10-04T12:22:46.910-0400 W REPL [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source cannot be behind me, and if I am up-to-date with the sync source, it must have a higher lastOpCommitted. My last fetched oplog optime: { ts: Timestamp(1538669483, 1), t: 1 }, latest oplog optime of sync source: { ts: Timestamp(1538669483, 1), t: 1 }, my lastOpCommitted: { ts: Timestamp(1538669483, 1), t: 1 }, lastOpCommitted of sync source: { ts: Timestamp(1538669483, 1), t: 1 } 2018-10-04T12:22:46.915-0400 I REPL [rsBackgroundSync] Clearing sync source jazzstep-2.local:9007 to choose a new one. 2018-10-04T12:22:46.918-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T12:22:46.920-0400 I REPL [replexec-9] Member jazzstep-2.local:9008 is now in state PRIMARY 2018-10-04T12:22:46.231-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9008 2018-10-04T12:22:46.232-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:50.106-0400 I NETWORK [conn21] end connection 10.1.25.36:58975 (7 connections now open) 2018-10-04T12:22:50.106-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9008 2018-10-04T12:22:50.108-0400 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update to jazzstep-2.local:9007: InvalidSyncSource: Sync source changed from jazzstep-2.local:9007 to jazzstep-2.local:9008 2018-10-04T12:22:50.114-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:50.136-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62686 #42 (8 connections now open) 2018-10-04T12:22:50.137-0400 I NETWORK [conn42] received client metadata from 10.1.25.36:62686 conn42: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:55.433-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:22:55.470-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 705824ms ms 2018-10-04T12:22:55.475-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:22:55.478-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:22:55.482-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:22:56.917-0400 I NETWORK [conn39] end connection 127.0.0.1:62648 (7 connections now open) 2018-10-04T12:23:06.070-0400 I NETWORK [conn26] end connection 10.1.25.36:59007 (6 connections now open) 2018-10-04T12:23:25.441-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:23:25.489-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:23:25.490-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:23:25.490-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:23:36.075-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63515 #43 (7 connections now open) 2018-10-04T12:23:36.075-0400 I NETWORK [conn43] received client metadata from 10.1.25.36:63515 conn43: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.968-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:01.969-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:01.970-0400 I ASIO [RS] Dropping all pooled connections to jazzstep-2.local:9007 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:01.971-0400 I REPL [replication-0] Restarting oplog query due to error: NetworkInterfaceExceededTimeLimit: error in fetcher batch callback :: caused by :: timed out. Last fetched optime (with hash): { ts: Timestamp(1538670220, 1), t: 2 }[-9113168510407357519]. Restarts remaining: 1 2018-10-04T12:30:01.971-0400 I NETWORK [conn37] end connection 127.0.0.1:62642 (6 connections now open) 2018-10-04T12:30:01.972-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9008 due to bad connection status; 0 connections to that host remain open 2018-10-04T12:30:01.972-0400 I NETWORK [conn35] end connection 127.0.0.1:62637 (5 connections now open) 2018-10-04T12:30:01.973-0400 I REPL [replication-0] Scheduled new oplog query Fetcher source: jazzstep-2.local:9008 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538670220, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 2, readConcern: { afterClusterTime: Timestamp(1538670220, 1) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 7000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 2573 -- target:jazzstep-2.local:9008 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538670220, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 2, readConcern: { afterClusterTime: Timestamp(1538670220, 1) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms 2018-10-04T12:30:01.975-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.977-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.980-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63669 #46 (6 connections now open) 2018-10-04T12:30:01.981-0400 I NETWORK [conn46] received client metadata from 10.1.25.36:63669 conn46: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.988-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63675 #47 (7 connections now open) 2018-10-04T12:30:01.989-0400 I NETWORK [conn47] received client metadata from 10.1.25.36:63675 conn47: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.989-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63680 #48 (8 connections now open) 2018-10-04T12:30:01.990-0400 I NETWORK [conn48] received client metadata from 10.1.25.36:63680 conn48: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.999-0400 W REPL [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source cannot be behind me, and if I am up-to-date with the sync source, it must have a higher lastOpCommitted. My last fetched oplog optime: { ts: Timestamp(1538670220, 1), t: 2 }, latest oplog optime of sync source: { ts: Timestamp(1538670220, 1), t: 2 }, my lastOpCommitted: { ts: Timestamp(1538670220, 1), t: 2 }, lastOpCommitted of sync source: { ts: Timestamp(1538670220, 1), t: 2 } 2018-10-04T12:30:02.000-0400 I REPL [rsBackgroundSync] Clearing sync source jazzstep-2.local:9008 to choose a new one. 2018-10-04T12:30:02.000-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T12:30:02.002-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:02.003-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9007 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:02.004-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9008 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:02.004-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:02.005-0400 I REPL [replexec-12] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-10-04T12:30:02.006-0400 I REPL [replexec-12] conducting a dry run election to see if we could be elected. current term: 2 2018-10-04T12:30:02.007-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:02.007-0400 I REPL [replexec-8] VoteRequester(term 2 dry run) received a no vote from jazzstep-2.local:9007 with reason "candidate's term (2) is lower than mine (3)"; response message: { term: 3, voteGranted: false, reason: "candidate's term (2) is lower than mine (3)", ok: 1.0, operationTime: Timestamp(1538670220, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('7fffffff0000000000000001') }, lastCommittedOpTime: Timestamp(1538670220, 1), $clusterTime: { clusterTime: Timestamp(1538670220, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:30:02.008-0400 I REPL [replexec-8] not running for primary, we have been superseded already during dry run. original term: 2, current term: 3 2018-10-04T12:30:02.011-0400 I REPL [replexec-12] Member jazzstep-2.local:9008 is now in state SECONDARY 2018-10-04T12:30:02.508-0400 I REPL [replexec-11] Member jazzstep-2.local:9007 is now in state PRIMARY 2018-10-04T12:30:03.431-0400 I NETWORK [conn42] end connection 10.1.25.36:62686 (7 connections now open) 2018-10-04T12:30:04.106-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9007 2018-10-04T12:30:04.107-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:30:04.122-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63786 #52 (8 connections now open) 2018-10-04T12:30:04.123-0400 I NETWORK [conn52] received client metadata from 10.1.25.36:63786 conn52: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.140-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9007 2018-10-04T12:30:04.141-0400 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update to jazzstep-2.local:9008: InvalidSyncSource: Sync source changed from jazzstep-2.local:9008 to jazzstep-2.local:9007 2018-10-04T12:30:04.142-0400 I ASIO [RS] Connecting to jazzstep-2.local:9007 2018-10-04T12:30:08.597-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:08.639-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 403149ms ms 2018-10-04T12:30:08.640-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:30:08.641-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:30:08.641-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:30:19.246-0400 I NETWORK [conn43] end connection 10.1.25.36:63515 (7 connections now open) 2018-10-04T12:30:38.623-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:38.669-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:30:38.669-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:30:38.670-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:01.992-0400 I NETWORK [conn47] end connection 10.1.25.36:63675 (6 connections now open) 2018-10-04T12:31:01.996-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:31:02.011-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:31:08.630-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:08.677-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:08.678-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:08.678-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:38.633-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:38.680-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:38.681-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:38.682-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:31:49.271-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49288 #54 (7 connections now open) 2018-10-04T12:31:49.272-0400 I NETWORK [conn54] received client metadata from 10.1.25.36:49288 conn54: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:32:08.596-0400 I SH_REFR [ConfigServerCatalogCacheLoader-3] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:32:08.597-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Not primary while running findAndModify command on collection config.locks, will try again at the next refresh interval 2018-10-04T12:32:08.598-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:08.636-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:08.685-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:08.685-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:08.686-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:08.687-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb64088bce8d7a2b5cc21cb and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:38.643-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:38.691-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:38.693-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:38.694-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:32:38.695-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb64088bce8d7a2b5cc21cb and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:08.646-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:08.698-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:08.699-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:08.700-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:08.701-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb64088bce8d7a2b5cc21cb and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:38.650-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:38.703-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:38.704-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:38.705-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:33:38.706-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb64088bce8d7a2b5cc21cb and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:34:08.652-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:34:08.708-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb638ebbce8d7a2b5cc1cd7 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:34:08.709-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63a17bce8d7a2b5cc1e75 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:34:08.709-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb63b43bce8d7a2b5cc2011 and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks 2018-10-04T12:34:08.710-0400 W SHARDING [replSetDistLockPinger] Failed to unlock lock with ts: 5bb64088bce8d7a2b5cc21cb and _id: config :: caused by :: NotMaster: Not primary while running findAndModify command on collection config.locks