[SERVER-20316] Relax thread level comparisons on mongo-perf check script Created: 08/Sep/15 Updated: 21/Sep/15 Resolved: 08/Sep/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | 3.0.7, 3.1.8 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | David Daly | Assignee: | David Daly |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Backwards Compatibility: | Fully Compatible |
| Backport Completed: | |
| Sprint: | CAP 9 (09/18/15) |
| Participants: |
| Description |
|
The perf analysis script has been giving some false positives on mongo-perf on the per thread level comparisons. Going to relax the constraints for per thread level comparison to only flag an error for a 10% regression or larger, and 2x the noise margin. This does not affect the comparison for the max throughput. |
| Comments |
| Comment by Githook User [ 17/Sep/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: (cherry picked from commit b5e486fcaf73847aa41c2fc55ca94fab3c4eb1cc) |
| Comment by Githook User [ 08/Sep/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: |