-
Type: Typo
-
Resolution: Fixed
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Spark Connector
-
Labels:
Hello,
In the Mongo Spark Connector documentation, there seems to be a mistake. We're asked to use spark.mongodb.read.partitionerOptions instead of partitioner.options in case we give configuration via Spark.
https://www.mongodb.com/docs/spark-connector/current/configuration/read/
So for example:
partitioner.options.partition.field | spark.mongodb.read.partitionerOptions.partition.field |
But this seems to be wrong looking at the code, it should be :
If you use SparkConf to set the connector's read configurations, prefix each property with
spark.mongodb.read.partitioner.options. instead of partitioner.options.