When you have a lot of sharded collections perfectly balanced across X shards, adding a new shard will cause all existing collections to rebalance across X+1 shards, which might take some time.

I suggest to put a note about this in our docs, as some users apparently expect mongoS to only rebalance newly sharded collections.