When adding members to a shard's replica set, the connection string on the config server also has to be updated.

The guide tutorial/convert-standalone-to-replica-set.txt has a "sharding considerations" section that discusses it.

The guide tutorial/expand-replica-set.txt does not mention it at all. It should have a similar section.