Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-177

sqlContext.read.option(...).mongo() fails when authentication require

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      This works

          val sparkSession: SparkSession = SparkSession.builder()
      .master("local")
      .appName("MongoSparkConnectorIntro")
      .config("spark.mongodb.input.uri", "mongodb://127.0.0.1/nasa.eva2")
      .config("spark.mongodb.output.uri", "mongodb://127.0.0.1/nasa.astronautTotals")
      .getOrCreate()
    val sqlContext: SQLContext = sparkSession.sqlContext

    val evadf: DataFrame = sqlContext.read.option("collection", "eva2").mongo()
    evadf.printSchema()

      But this fails

          val sparkSession: SparkSession = SparkSession.builder()
      .master("local")
      .appName("MongoSparkConnectorIntro")
      .config("spark.mongodb.input.uri", "mongodb://m103-admin:m103-pass@192.168.103.100:27000/nasa.eva2?authSource=admin")
      .config("spark.mongodb.output.uri", "mongodb://m103-admin:m103-pass@192.168.103.100:27000/nasa.astronautTotals?authSource=admin
")
      .getOrCreate()
    val sqlContext: SQLContext = sparkSession.sqlContext

    val evadf: DataFrame = sqlContext.read.option("collection", "eva2").mongo()
    evadf.printSchema()

      Why?

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            daleangus Dale Angus
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: