[SERVER-28731] Microbenchmarks: Relax default threshold to 7.5% Created: 11/Apr/17  Updated: 12/Apr/17  Resolved: 11/Apr/17

Status: Closed
Project: Core Server
Component/s: Performance
Affects Version/s: None
Fix Version/s: 3.5.6

Type: Improvement Priority: Major - P3
Reporter: Henrik Ingo (Inactive) Assignee: Henrik Ingo (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-28210 Set microbenchmarks default threshold... Closed
Backwards Compatibility: Fully Compatible
Sprint: Performance 2017-04-17
Participants:

 Description   

In SERVER-28210 we tightened the default threshold for Microbenchmarks master branch from 10% to 5%. This seemed to work well for a while. A small number of tests needed higher thresholds, and we've set them on a test by test basis. However, recently we've had more failures which seem to be just false positives, and on a wide range of quite basic tests, such as a dozen update tests.

We will relax the threshold back to 7.5%.



 Comments   
Comment by Githook User [ 12/Apr/17 ]

Author:

{u'username': u'henrikingo', u'name': u'Henrik Ingo', u'email': u'henrik.ingo@mongodb.com'}

Message: SERVER-28731 system_perf.yml: Remove accidental change of which ycsb test to run

Fixes f609c09f944968970ee87a1c0c169c3af1ea0935
Branch: master
https://github.com/mongodb/mongo/commit/1db2940cbc397b3fd8b5250024b85ffa175cccd8

Comment by Githook User [ 11/Apr/17 ]

Author:

{u'username': u'henrikingo', u'name': u'Henrik Ingo', u'email': u'henrik.ingo@mongodb.com'}

Message: SERVER-28731 Microbenchmarks: Relax default threshold to 7.5%
Branch: master
https://github.com/mongodb/mongo/commit/f609c09f944968970ee87a1c0c169c3af1ea0935

Generated at Thu Feb 08 04:18:54 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.