[SERVER-20316] Relax thread level comparisons on mongo-perf check script Created: 08/Sep/15  Updated: 21/Sep/15  Resolved: 08/Sep/15

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.0.7, 3.1.8

Type: Improvement Priority: Major - P3
Reporter: David Daly Assignee: David Daly
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Backport Completed:
Sprint: CAP 9 (09/18/15)
Participants:

 Description   

The perf analysis script has been giving some false positives on mongo-perf on the per thread level comparisons. Going to relax the constraints for per thread level comparison to only flag an error for a 10% regression or larger, and 2x the noise margin.

This does not affect the comparison for the max throughput.



 Comments   
Comment by Githook User [ 17/Sep/15 ]

Author:

{u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}

Message: SERVER-20316: Relax thread level comparisons on mongo-perf check script

(cherry picked from commit b5e486fcaf73847aa41c2fc55ca94fab3c4eb1cc)
Branch: v3.0
https://github.com/mongodb/mongo/commit/31d1c9ee2892aa8070d7141ee6105d21c647ca37

Comment by Githook User [ 08/Sep/15 ]

Author:

{u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}

Message: SERVER-20316: Relax thread level comparisons on mongo-perf check script
Branch: master
https://github.com/mongodb/mongo/commit/b5e486fcaf73847aa41c2fc55ca94fab3c4eb1cc

Generated at Thu Feb 08 03:53:51 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.