mongodb config server can not stepdown

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Gone away
    • Priority: Critical - P2
    • None
    • Affects Version/s: 3.4.9
    • Component/s: None
    • None
    • ALL
    • None
    • 0
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      after Upgrade Config Servers to Replica Set,it can not stepdown in parmary , it issue:

      rs.stepDown()
      {
              "ok" : 0,
              "errmsg" : "No electable secondaries caught up as of 2017-10-16T13:44:02.216+0800. Please use {force: true} to force node to step down.",
              "code" : 50,
              "codeName" : "ExceededTimeLimit"
      

      and i use keyfile auth the database.the secondary is :

      product_operation_listing_management.sku_images command: count { count: "sku_images", query: { skuId: { $in: [ "a11120200ux0542", "a12092700ux0316", "a12110600ux0434", "a14081900ux0677", "a15051500ux0050", "a15051500ux0071", "a15052900ux0414", "a15061700ux0806", "a15102900ux0336", "a15110300ux0055", "a15112400ux0300", "a15113000ux2072", "a15121900ux1795", "a16111900ux0056", "a16111900ux0071", "a16111900ux0072", "a16111900ux0074", "a16112100ux0044", "a16112100ux0050", "a16112100ux0053", "a16112100ux0059", "a16112100ux0070", "a16112100ux0191", "a16112100ux0220", "a16112100ux0263", "a16112100ux1217", "a16112100ux1218", "a16112100ux1223", "a16112100ux1232", "a16112300ux0171", "a13062600ux0709", "a14120200ux0042" ] } } } planSummary: IXSCAN { skuId: "hashed" } keysExamined:26 docsExamined:11 numYields:2 reslen:124 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, Collection: { acquireCount: { r: 3 } } } protocol:op_query 154ms
      

      replica set

      2017-10-16T18:59:46.385+0800 I NETWORK  [conn137] received client metadata from 192.168.169.60:36295 conn137: { driver: { name: "NetworkInterfaceASIO-ShardRegistry", version: "3.4.9" }, os: { type: "Linux", name: "CentOS release 6.6 (Final)", architecture: "x86_64", version: "Kernel 2.6.32-504.16.2.el6.x86_64" } }
      2017-10-16T18:59:46.388+0800 I ACCESS   [conn137] Successfully authenticated as principal __system on local
      2017-10-16T19:00:13.677+0800 I ACCESS   [conn37] SCRAM-SHA-1 authentication failed for admin on admin from client 192.168.169.62:24256 ; AuthenticationFailed: SCRAM-SHA-1 authentication failed, storedKey mismatch
      2017-10-16T19:02:13.787+0800 I REPL     [replication-5] Restarting oplog query due to error: InterruptedDueToReplStateChange: operation was interrupted. Last fetched optime (with hash): { ts: Timestamp 1508151723000|2, t: 6 }[-7454072674456839620]. Restarts remaining: 3
      2017-10-16T19:02:13.788+0800 I REPL     [replication-5] Scheduled new oplog query Fetcher source: 192.168.169.60:22004 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1508151723000|2 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 6 } query metadata: { $replData: 1, $oplogQueryData: 1, $ssm: { $secondaryOk: true } } active: 1 timeout: 65000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 142029 -- target:192.168.169.60:22004 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp 1508151723000|2 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 6 } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms
      2017-10-16T19:02:13.797+0800 W REPL     [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source's last applied OpTime { ts: Timestamp 1508151723000|2, t: 6 } is not greater than our last fetched OpTime { ts: Timestamp 1508151723000|2, t: 6 }. Choosing new sync source.
      2017-10-16T19:02:13.798+0800 I REPL     [rsBackgroundSync] could not find member to sync from
      2017-10-16T19:02:18.753+0800 I REPL     [SyncSourceFeedback] SyncSourceFeedback error sending update to 192.168.169.60:22004: InvalidSyncSource: Sync source was cleared. Was 192.168.169.60:22004
      2017-10-16T19:02:23.800+0800 I REPL     [rsBackgroundSync] sync source candidate: 192.168.169.60:22004
      2017-10-16T19:02:23.803+0800 I COMMAND  [conn111] command config.settings command: find { find: "settings", filter: { _id: "balancer" }, readConcern: { level: "majority", afterOpTime: { ts: Timestamp 1508151742000|13, t: 6 } }, limit: 1, maxTimeMS: 30000 } planSummary: IDHACK keysExamined:1 docsExamined:1 cursorExhausted:1 numYields:0 nreturned:1 reslen:405 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { r: 1 } } } protocol:op_command 1486ms
      2017-10-16T19:02:23.803+0800 I COMMAND  [conn81] command config.settings command: find { find: "settings", filter: { _id: "chunksize" }, readConcern: { level: "majority", afterOpTime: { ts: Timestamp 1508151742000|13, t: 6 } }, limit: 1, maxTimeMS: 30000 } planSummary: IDHACK keysExamined:1 docsExamined:1 cursorExhausted:1 numYields:0 nreturned:1 reslen:396 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { r: 1 } } } protocol:op_command 1486ms
      2017-10-16T19:02:24.833+0800 I NETWORK  [thread2] connection accepted from 192.168.169.61:63533 #138 (23 connections now open)
      2017-10-16T19:02:24.834+0800 I NETWORK  [conn138] received client metadata from 192.168.169.61:63533 conn138: { driver: { name: "NetworkInterfaceASIO-RS", version: "3.4.9" }, os: { type: "Linux", name: "CentOS release 6.6 (Final)", architecture: "x86_64", version: "Kernel 2.6.32-504.16.2.el6.x86_64" } }
      2017-10-16T19:02:24.838+0800 I ACCESS   [conn138] Successfully authenticated as principal __system on local
      2017-10-16T19:02:24.840+0800 I NETWORK  [thread2] connection accepted from 192.168.169.61:63534 #139 (24 connections now open)
      2017-10-16T19:02:24.840+0800 I NETWORK  [conn139] received client metadata from 192.168.169.61:63534 conn139: { driver: { name: "NetworkInterfaceASIO-RS", version: "3.4.9" }, os: { type: "Linux", name: "CentOS release 6.6 (Final)", architecture: "x86_64", version: "Kernel 2.6.32-504.16.2.el6.x86_64" } }
      2017-10-16T19:02:24.843+0800 I ACCESS   [conn139] Successfully authenticated as principal __system on local
      

        1. config.tar
          9 kB
        2. configparmarylog.gz
          3.35 MB
        3. configsecondary1log.gz
          7.98 MB
        4. configsecondary2log.gz
          7.83 MB

            Assignee:
            Mark Agarunov (Inactive)
            Reporter:
            SuperSuJJ [X]
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: