While passing large arguments in $in block like 100K to 200k for match pipeline the index is not considered. For the same query if we reduce the parameters in 1000 it is considering index.
We are running it in Spark 2.2 and mongo version 3.4.9 and code is written in scala to execute it as spark-submit command.