Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-161

index on nested struct could be push down

    • Type: Icon: Improvement Improvement
    • Resolution: Won't Fix
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Performance
    • Labels:
      None

      if there is a sql like
      `select * from test where _id.oid='test'`
      current connector will scan full collection
      because
      `MongodbRelation extends PrunedFilteredScan`
      it can not push down nested struct filter
      I think it can use `CatalystScan` to push down nested struct query

            Assignee:
            Unassigned Unassigned
            Reporter:
            zzxzz12345 Chong Hu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: