Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-295

Control Number of Parallel Connections in Spark-mongo connector

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Gone away
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
      None

      Description

      Hi Team,

      I am using spark-mongo connector version 3.0.1 for migrating data from Sharded MongoDB cluster. 
      I wanted to know, how can be control the number of parallel connection from spark to MongoDB. As per DBA there are 4000 connections are spawned for my query and still the result isn't come. 
      So if anybody can help to identify how to control this parallel threads, I didn't find any mention of it in the official documentation.

        Attachments

          Activity

            People

            Assignee:
            ross.lawley Ross Lawley
            Reporter:
            ankit_pandey02@outlook.com Ankit Pandey
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: