[SERVER-54423] Re-run the sys-perf/bestbuy benchmarks Created: 09/Feb/21  Updated: 11/May/21  Resolved: 11/May/21

Status: Closed
Project: Core Server
Component/s: Querying
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Drew Paroski Assignee: Drew Paroski
Resolution: Done Votes: 0
Labels: qexec-team
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-53036 [SBE] Investigate why several sys-per... Closed
Related
related to SERVER-54078 [SBE] Improve perf of the bestbuy_agg... Closed
related to SERVER-54379 [SBE] Diagnose 10% regression for the... Closed
Sprint: Query Execution 2021-05-03, Query Execution 2021-05-17
Participants:

 Description   

The goal of this task is to re-run the sys-perf/bestbuy benchmarks one more time to ensure there are no functional failures and that there are no significant perf regressions.

When running these benchmarks, it would also be good to check the following:



 Comments   
Comment by Drew Paroski [ 11/May/21 ]

I re-ran the sys-perf/bestbuy benchmarks for the "Linux 3-Node ReplSet" and "Linux 3-Shard Cluster" build variants. Here are the results:
  - Linux 3-Node ReplSet: https://docs.google.com/spreadsheets/d/1iTCnKfHEe4mo92TlpxJtU3uzcfTBIeBzbRNeB2Czzac/edit#gid=985163840
  - Linux 3-Shard Cluster: https://docs.google.com/spreadsheets/d/1iTCnKfHEe4mo92TlpxJtU3uzcfTBIeBzbRNeB2Czzac/edit#gid=234403502

Comparing the results between the classic engine and SBE, there were no failures that were SBE specific.

There were a couple benchmarks that had regressions when SBE was enabled. I will open a Jira ticket for investigating and fixing each regression.

Generated at Thu Feb 08 05:33:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.