If you have a mongos that you create the sharded cluster with and another mongos that the application is accessing, if you add a shard and data is migrated to the new shard, an app doing queries through the non-config mongos will not update its config and so will not find migrated documents.

Working on writing up the reproduction steps.