Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-54

Create a pagination partitioner

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4
    • Component/s: None
    • Labels:
      None

      Description

      As the MongoSinglePartitioner offers no parallelism, provide a simple pagination partitioner that partitions a collection by _id ranges.

      It's relatively expensive to compute, but would require no special privileges, compared to splitVector route.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              ross.lawley Ross Lawley
              Reporter:
              ross.lawley Ross Lawley
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: