Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-34427

Aggregation Query With $in for large Datasets Index not considered via spark

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Incomplete
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Aggregation Framework
    • None
    • ALL

    Description

      While passing large arguments in $in block like 100K to 200k for match pipeline the index is not considered. For the same query if we reduce the parameters in 1000 it is considering index.
      We are running it in Spark 2.2 and mongo version 3.4.9 and code is written in scala to execute it as spark-submit command.

      Attachments

        Activity

          People

            kelsey.schubert@mongodb.com Kelsey Schubert
            badrinarayanan_p@infosys.com Badrinarayanan P
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: