[SERVER-70537] Cost model: end to end benchmark Created: 13/Oct/22  Updated: 29/Oct/23  Resolved: 07/Nov/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.2.0-rc0

Type: Task Priority: Major - P3
Reporter: Alexander Ignatyev Assignee: Alexander Ignatyev
Resolution: Fixed Votes: 0
Labels: M6
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Sprint: QO 2022-11-14
Participants:

 Description   

A/B performance test to compare plans produced by two sets of cost model coefficients.

Run every variant a number of times (10-20) then check the NULL hypothesis that the running time of both variants are the same using t-test.

The results should include: the mean values, p-value of the t-test, and ABT and SBE trees for the plans produces by the sets of cost model coefficients.



 Comments   
Comment by Githook User [ 03/Nov/22 ]

Author:

{'name': 'Alexander Ignatyev', 'email': 'alexander.ignatyev@mongodb.com', 'username': 'aligusnet'}

Message: SERVER-70537 Implement end to end cost model benchmark.
Branch: master
https://github.com/mongodb/mongo/commit/4acc5a37048c9080e0cd6a0615ba5506da539df0

Generated at Thu Feb 08 06:16:26 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.