Details
-
Improvement
-
Resolution: Declined
-
Major - P3
-
None
-
None
-
None
Description
Customers such as Spireon Wrote their own custom partitioner for the Spark Connector, as they found the out-of-box partitioners were too slow for theirĀ 30 Terabytes collection. The ability for users to create their own partitioners is a beneficial feature of the Spark Connector which we should document for our users.
Attachments
Issue Links
- is related to
-
SPARK-221 Partitioners silently lose data when partitionKey has unmatching types
-
- Closed
-
- links to