Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-295

Control Number of Parallel Connections in Spark-mongo connector

    • Type: Icon: Task Task
    • Resolution: Gone away
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Configuration
    • Labels:

      Hi Team,

      I am using spark-mongo connector version 3.0.1 for migrating data from Sharded MongoDB cluster. 
      I wanted to know, how can be control the number of parallel connection from spark to MongoDB. As per DBA there are 4000 connections are spawned for my query and still the result isn't come. 
      So if anybody can help to identify how to control this parallel threads, I didn't find any mention of it in the official documentation.

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            ankit_pandey02@outlook.com Ankit Pandey
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: