Uploaded image for project: 'Documentation'
  1. Documentation
  2. DOCS-11644

Incorrect dependencies for Spark connector v2.2.2

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Critical - P2 Critical - P2
    • None
    • None
    • Spark Connector
    • None

    Description

      The documentaion for Spark Connector suggests that a dependency for v2.2.2 should be used for the spark-sql_2.11 and spark-core_2.11 artefacts:

      <dependencies>
        <dependency>
          <groupId>org.apache.spark</groupId>
          <artifactId>spark-core_2.11</artifactId>
          <version>2.2.2</version>
        </dependency>
        <dependency>
          <groupId>org.mongodb.spark</groupId>
          <artifactId>mongo-spark-connector_2.11</artifactId>
          <version>2.2.2</version>
        </dependency>
        <dependency>
          <groupId>org.apache.spark</groupId>
          <artifactId>spark-sql_2.11</artifactId>
          <version>2.2.2</version>
        </dependency>
      </dependencies>
      

      That contradicts with the dependencies that are listed for mongo-spark-connector v2.2.2 on Maven Central.

      Also if I try to use the dependencies example from the docs in my own project, the spark-sql_2.11 and spark-core_2.11 v2.2.2 packages cannot be found - most likely because these versions simply don't exist:

      Attachments

        Activity

          People

            jonathan.destefano@mongodb.com Jonathan DeStefano
            dmitry.ryabtsev@mongodb.com Dmitry Ryabtsev
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:
              5 years, 42 weeks ago