Partitioners extending FieldPartitioner do not support nested partition fields

ExportXMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Unresolved
    • Priority: Unknown
    • None
    • Affects Version/s: 11.0.0
    • Component/s: Partitioners
    • Java Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      The partitioners extending FieldPartitioner do not support nested partition fields. The loaded values from MongoDB are read via document.get(partitionField) which does not work with nested path.

      The returned value would be null and lead to unclear erros about duplicated keys or not supported topology, like "com.mongodb.spark.sql.connector.exceptions.MongoSparkException: Partitioning failed. Invalid partitioner configuration. The partitions generated contain duplicates:..."

        1. mvn_java_project_to_repro.zip
          5 kB

            Assignee:
            Unassigned
            Reporter:
            Aleksandr Sanitckii
            None
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: