Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4839

Add a feature to python testsuite to run a random subset of tests

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT3.2.1, 4.3.1, 4.2.0-rc2
    • Component/s: None
    • Labels:
      None
    • Story Points:
      3
    • Sprint:
      Storage Engines 2019-06-17
    • Backport Requested:
      v4.2

      Description

      We have over 6000 test scenarios that the whole python test suite executes. It takes considerable time to run them all. It will be worthwhile to add a feature to the suite, where we can pick every Nth test (randomly) and execute a smaller subset of the whole suite.

      This could be useful when we want to quickly execute a small number of tests before creating the pull request.

      This could be a command line argument to run.py.

      For instance, the following will run every 10th test (from a randomly picked list of all test scenarios):

      ./run.py --Nth 10
      

      The following will run every 3rd test (from a randomly picked list of all timestamp test scenarios):

      ./run.py --Nth 10 timestamp
      

        Attachments

          Activity

            People

            Assignee:
            sulabh.mahajan Sulabh Mahajan
            Reporter:
            sulabh.mahajan Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: