I found my clients or mongo shell cannot connect to mongos occasionally.

Mongo shell showed that it was connecting, but timed out.

After I stepDown config server primary, all the clients can immediately connected.

Is this a bug which had been fix in 4.4.6 or some of my configurations aren't correct?

Log of mongos or config server seems nothing wrong.