Shuffle order of tests via smoke.py

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Duplicate
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Testing Infrastructure
    • None
    • Fully Compatible
    • Quint Iteration 3
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      We'd like to have smoke.py shuffle the tests in a suite. It should take a seed as a parameter to use for randomizing the shuffle. If a seed isn't provided, it should use the current git hash. This way, each build that buildbot runs has a different shuffle for running tests within a suite, but it is still easily reproducible.

              Assignee:
              Max Hirschhorn
              Reporter:
              Eric Milkie
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: