[SERVER-69993] ☂️ Umbrella ticket for SBE $group pushdown performance Created: 26/Sep/22  Updated: 27/Oct/23  Resolved: 23/Feb/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: David Storch Assignee: Backlog - Query Execution
Resolution: Gone away Votes: 0
Labels: pm2697-m3
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File group_perf_e63e4961f27a9a6a4b9ae5b84c0d7e67e2f9d4db.txt    
Issue Links:
Depends
depends on SERVER-61948 Improve SBE $group pushdown scalabili... Closed
depends on SERVER-61949 Improve SBE $group pushdown scalabili... Closed
Assigned Teams:
Query Execution
Sprint: QE 2022-10-03, QE 2022-10-17, QE 2022-10-31, QE 2022-11-14, QE 2022-11-28, QE 2022-12-12, QE 2022-12-26, QE 2023-01-09
Participants:
Story Points: 2

 Comments   
Comment by David Storch [ 17/Oct/22 ]

Tests with "critical" regressions:

  • Aggregation.Group.MultipleAccDiffTopFieldsStress_LL10
  • Aggregation.Group.MultipleAccSameTopFieldStress_LL10
  • Aggregation.Group.MultipleAccDiffTopFields_LLR10

Tests with "important" regressions:

  • count_with_and_predicate-useAgg
  • count_no_predicate-useAgg
Comment by David Storch [ 17/Oct/22 ]

I generated the attached file group_perf_e63e4961f27a9a6a4b9ae5b84c0d7e67e2f9d4db.txt which contains information about the performance of SBE relative to classic for our $group benchmarks at githash e63e4961f27a9a6a4b9ae5b84c0d7e67e2f9d4db. I used the following query against the PerformanceReports Atlas cluster:

let cursor = db.getSiblingDB("perfreports").sbe_perf_latest.aggregate([
    {$match: {tags: "group"}},
    {$sort: {signed_percent_change_stable: 1}},
    {
        $project: {
            task: 1,
            test: 1,
            measurement: 1,
            args_str: 1,
            value_measure: 1,
            stable_mean_baseline: 1,
            stable_std_baseline: 1,
            signed_percent_change_stable: 1,
            signed_z_score_change_stable: 1,
            tags: 1
        }
    }
]);
 
while (cursor.hasNext()) {
    printjson(cursor.next());
}

Generated at Thu Feb 08 06:14:59 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.