Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-7463

$percentile and $top aggregation accumulators for $group

    Details

      Description

      Now that the nuts and bolts of aggregation have been taken care of with the new aggregation framework, higher level functions like percentile and top, which we use extensively to report on metrics is highly desirable.
      Splunk lets me write custom operators and hook them into the query pipeline. Having something similar would be a great enhancement to the aggregation framework.

        Issue Links

          Activity

          Hide
          sturadnidge Stuart Radnidge added a comment -

          $pow and $log would be really useful to have, trying to use combinations of $multiply and $divide to do the same gets ugly fast!

          Show
          sturadnidge Stuart Radnidge added a comment - $pow and $log would be really useful to have, trying to use combinations of $multiply and $divide to do the same gets ugly fast!
          Hide
          charlie.swanson Charlie Swanson added a comment -

          Let's keep this ticket focused on $top and $percentile. Other additions can be addressed separately.

          In order to calculate $top or $percentile, we would need to hold on to all documents in the pipeline. This does not fit into the current streaming architecture.

          Show
          charlie.swanson Charlie Swanson added a comment - Let's keep this ticket focused on $top and $percentile. Other additions can be addressed separately. In order to calculate $top or $percentile, we would need to hold on to all documents in the pipeline. This does not fit into the current streaming architecture.
          Hide
          cstepnitz Christine Stepnitz added a comment -

          One possible implementation approach for quantiles would be to use a TDigest, such as is documented and implemented in this simple library: https://github.com/tdunning/t-digest

          Show
          cstepnitz Christine Stepnitz added a comment - One possible implementation approach for quantiles would be to use a TDigest, such as is documented and implemented in this simple library: https://github.com/tdunning/t-digest

            People

            • Votes:
              19 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

              • Created:
                Updated:
                Days since reply:
                4 weeks, 6 days ago
                Date of 1st Reply: