We've been seeing a rise in the number of build failures related to validation rise recently. Reproducing these failures is often very time-consuming. For example, I had a build failure related to validation failing that I wasn't able to reproduce until I changed the hook script to run more validation threads concurrently.

It would be a useful feature to be able to change the number of validation jobs or their frequency for build failure reproduction from the resmoke invocation.