Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-28667

Provide a way for the Aggregation framework to query against intervals of a hashed index

    XMLWordPrintableJSON

Details

    • Icon: New Feature New Feature
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • 3.4.3
    • Aggregation Framework
    • None
    • Query Optimization

    Description

      The Spark connector uses the Aggregation Framework to create data partitions that are sent to Spark workers. In a sharded cluster it makes sense to align these partitions to chunk boundaries so that each worker's data loading query is targeted to a single shard.

      This however is impossible when the shard key is a hashed index. A simple find can use $min / $max but there is no comparable facility in the aggregation framework.

      Attachments

        Activity

          People

            backlog-query-optimization Backlog - Query Optimization
            sylvain.chambon@mongodb.com Sylvain Chambon
            Votes:
            5 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated: