We have over 6000 test scenarios that the whole python test suite executes. It takes considerable time to run them all. It will be worthwhile to add a feature to the suite, where we can pick every Nth test (randomly) and execute a smaller subset of the whole suite.

This could be useful when we want to quickly execute a small number of tests before creating the pull request.

This could be a command line argument to run.py.

For instance, the following will run every 10th test (from a randomly picked list of all test scenarios):

./run.py --Nth 10

The following will run every 3rd test (from a randomly picked list of all timestamp test scenarios):

./run.py --Nth 10 timestamp