Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-28667

Provide a way for the Aggregation framework to query against intervals of a hashed index

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major - P3
    • Resolution: Unresolved
    • Affects Version/s: 3.4.3
    • Fix Version/s: Backlog
    • Component/s: Aggregation Framework
    • Labels:
      None
    • Case:

      Description

      The Spark connector uses the Aggregation Framework to create data partitions that are sent to Spark workers. In a sharded cluster it makes sense to align these partitions to chunk boundaries so that each worker's data loading query is targeted to a single shard.

      This however is impossible when the shard key is a hashed index. A simple find can use $min / $max but there is no comparable facility in the aggregation framework.

        Attachments

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-98 MongoShardedPartitioner and hashed shard keys not working correctly

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-14400 Using $min and $max on shard key doesn't target queries

          • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
          • Open
          related to

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-24274 Create a command to provide query bounds for partitioning data in a collection

          • Major - P3 - Major loss of function.
          • Open

            Activity

              People

              Assignee:
              backlog-query-optimization Backlog - Query Optimization
              Reporter:
              sylvain.chambon Sylvain Chambon
              Participants:
              Votes:
              5 Vote for this issue
              Watchers:
              16 Start watching this issue

                Dates

                Created:
                Updated: