[SERVER-5736] Shuffle order of tests via smoke.py Created: 01/May/12 Updated: 14/Apr/16 Resolved: 08/May/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Eric Milkie | Assignee: | Max Hirschhorn |
| Resolution: | Duplicate | Votes: | 1 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||
| Sprint: | Quint Iteration 3 | ||||||||
| Participants: | |||||||||
| Description |
|
We'd like to have smoke.py shuffle the tests in a suite. It should take a seed as a parameter to use for randomizing the shuffle. If a seed isn't provided, it should use the current git hash. This way, each build that buildbot runs has a different shuffle for running tests within a suite, but it is still easily reproducible. |
| Comments |
| Comment by Max Hirschhorn [ 08/May/15 ] |
|
This issue was resolved during the rewrite of smoke.py as part of |
| Comment by Daniel Crosta [ 29/May/12 ] |
|
Can you set a fix version on this and reassign to me? |
| Comment by Eric Milkie [ 01/May/12 ] |
|
The second half of this work will be to modify master.cfg to pass in a seed for the Nightlies and 2.0's so that they shuffle every night. We typically don't have a new git hash for the 2.0 builds every night so we'll need to come up with a different seed via buildbot master. |
| Comment by Daniel Crosta [ 01/May/12 ] |
|
Moved from BUILDBOT to SERVER. |