Provide a way for the Aggregation framework to query against intervals of a hashed index

XMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: 3.4.3
    • Component/s: Aggregation Framework
    • None
    • Query Optimization
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      The Spark connector uses the Aggregation Framework to create data partitions that are sent to Spark workers. In a sharded cluster it makes sense to align these partitions to chunk boundaries so that each worker's data loading query is targeted to a single shard.

      This however is impossible when the shard key is a hashed index. A simple find can use $min / $max but there is no comparable facility in the aggregation framework.

              Assignee:
              [DO NOT USE] Backlog - Query Optimization
              Reporter:
              Sylvain Chambon (Inactive)
              Votes:
              5 Vote for this issue
              Watchers:
              16 Start watching this issue

                Created:
                Updated: