Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-357

Missing Codec Exception thrown by using WHERE

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 10.0.3
    • Affects Version/s: None
    • Component/s: Reads
    • Labels:
      None

      Similar to SPARK-342 SPARK-340.

      Use of Timestamp and Scala Arrays in where statements use the codec registry directly and throw because of missing codecs. Unlike the write side which uses RowToBsonDocumentConverter.

      spark.read.format("mongodb").where("myArray == array('123')").collect()
      
      spark.read.format("mongodb").where("createdDate = cast('2022-01-06T07:06:51.628' as timestamp)").collect()
      

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            ross@mongodb.com Ross Lawley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: