Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-26723

Mongos stalls for even simple queries

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.2.5
    • Component/s: Sharding
    • None
    • ALL

      We have a 32 node cluster where each node is a 3 member replicaset having a hidden member.
      Cluster is running MongoDb 3.2.5 with WiredTiger on RHEL7.
      We see that some mongos processes get stuck and just do not return even for a very simple query while most other mongos processes are not affected.
      This happens to different nodes and is not limited to specific machines. It had happened yesterday on another machine and then after restarting the cluster, it happened on this machine.

      Queries like count() or show dbs or show collections that most probably access only the metadata - work fine on the mongos of the affected machine. However, running any simple query stalls the mongos.

      Attaching mongos logs for a mongos process that is not responding as well the config server primary node log.
      Note that the mongo processes were started with -v flag to increase logging verbosity

        1. bxb-ppe-oas006-mongos.stacks
          2.38 MB
          Darshan Shah
        2. mongod.log-20161021-chi-ppe-oas009.gz
          62.56 MB
          Darshan Shah
        3. mongodb_configdb-20161021-bxb-ppe-oas002.log.gz
          131.48 MB
          Darshan Shah
        4. mongos_bxb-ppe-oas006.log
          2.29 MB
          Darshan Shah
        5. mongos.log-20161021-bxb-ppe-oas010.gz
          103.13 MB
          Darshan Shah
        6. mongos.log-20161021-bxb-ppe-oas010-after_restart.gz
          12 kB
          Darshan Shah

            Assignee:
            kaloian.manassiev@mongodb.com Kaloian Manassiev
            Reporter:
            darshan.shah@interactivedata.com Darshan Shah
            Votes:
            1 Vote for this issue
            Watchers:
            18 Start watching this issue

              Created:
              Updated:
              Resolved: