Partitioners extending FieldPartitioner do not support nested partition fields

XMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Unresolved
    • Priority: Unknown
    • None
    • Affects Version/s: 11.0.0
    • Component/s: Partitioners
    • None
    • Java Drivers
    • None
    • None
    • None
    • None
    • None
    • None

      The partitioners extending FieldPartitioner do not support nested partition fields. The loaded values from MongoDB are read via document.get(partitionField) which does not work with nested path.

      The returned value would be null and lead to unclear erros about duplicated keys or not supported topology, like "com.mongodb.spark.sql.connector.exceptions.MongoSparkException: Partitioning failed. Invalid partitioner configuration. The partitions generated contain duplicates:..."

            Assignee:
            Unassigned
            Reporter:
            Aleksandr Sanitckii
            None
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: