[SERVER-15017] benchRun might return incorrect stats values Created: 25/Aug/14 Updated: 19/Sep/15 Resolved: 17/Jun/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | 2.6.4, 2.7.6 |
| Fix Version/s: | 3.0.5, 3.1.5 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Davide Italiano | Assignee: | David Daly |
| Resolution: | Done | Votes: | 0 |
| Labels: | 28qa | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Backwards Compatibility: | Minor Change | ||||
| Operating System: | ALL | ||||
| Backport Completed: | |||||
| Sprint: | CAP - 3.1.5 | ||||
| Participants: | |||||
| Description |
|
benchRun results might be slightly incorrect as long as the tool relies on serverStatus() calls rather than collecting stats client side. For the same reason (stats collected server side) two parallel executions of benchRun won't return per-client results (but cumulative results). As an added bonus, scotthernandez noticed that if the test lasts < 1 second, the results returned are completely broken, as showed in this testcase (provided by him).
|
| Comments |
| Comment by Githook User [ 02/Jul/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: Changes to handle benchrun result changes from (cherry picked from commit a446b28f19dad6fb8a2c7690946b6a187bd9e8bb) |
| Comment by Githook User [ 18/Jun/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: (cherry picked from commit 532571b5bc3db0560f41ad5e60a748ddd1782c85) Conflicts: |
| Comment by David Daly [ 17/Jun/15 ] |
|
Changes the results returned by benchrun. Mongo-perf updated to handle the change. |
| Comment by Githook User [ 17/Jun/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: |
| Comment by Githook User [ 17/Jun/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: Changes to handle benchrun result changes from (cherry picked from commit a446b28f19dad6fb8a2c7690946b6a187bd9e8bb) |
| Comment by Githook User [ 17/Jun/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: Changes to handle benchrun result changes from (cherry picked from commit a446b28f19dad6fb8a2c7690946b6a187bd9e8bb) |
| Comment by Githook User [ 17/Jun/15 ] |
|
Author: {u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}Message: Changes to handle benchrun result changes from |