Uploaded image for project: 'Documentation'
  1. Documentation
  2. DOCS-15666

[Spark] Description of giving partitioner options via SparkConf is not right

    XMLWordPrintableJSON

Details

    • Icon: Typo Typo
    • Resolution: Fixed
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Spark Connector

    Description

      Hello,

      In the Mongo Spark Connector documentation, there seems to be a mistake. We're asked to use spark.mongodb.read.partitionerOptions instead of partitioner.options in case we give configuration via Spark.

      https://www.mongodb.com/docs/spark-connector/current/configuration/read/

      So for example:

      partitioner.options.partition.field spark.mongodb.read.partitionerOptions.partition.field

      But this seems to be wrong looking at the code, it should be :

       
      If you use SparkConf to set the connector's read configurations, prefix each property with
      spark.mongodb.read.partitioner.options. instead of partitioner.options.
       

      Attachments

        Activity

          People

            chris.cho@mongodb.com Christopher Cho
            mehdi.elhajami.pro@gmail.com Mehdi El Hajami
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:
              1 year, 17 weeks, 5 days ago