Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-9

Improve data locality support

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1
    • Component/s: None
    • Labels:
    • # Replies:
      1
    • Last comment by Customer:
      false
    • Sprint:
      JVM Sprint 31, JVM Sprint 32

      Description

      Create a partitioner that can read from individual shards directly instead of via a MongoS

      Support the possibility of data locality by setting the preferred location(s) for a MongoRDD to be where the data resides. Then with a carefully configured setup it is possible to achieve data locality.

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            ross.lawley Ross Lawley
            Participants:
            Last commenter:
            Rathi Gnanasekaran
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Days since reply:
              4 years, 20 weeks, 2 days ago
              Date of 1st Reply: