Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-54

Create a pagination partitioner

    • Type: Icon: Task Task
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • 0.4
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      As the MongoSinglePartitioner offers no parallelism, provide a simple pagination partitioner that partitions a collection by _id ranges.

      It's relatively expensive to compute, but would require no special privileges, compared to splitVector route.

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            ross@mongodb.com Ross Lawley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: