When I run jstests locally it often limits my ability to keep working because any changes to the files will be picked up by the current running tests. This is especially true when I want to switch branches or work on the tests I just ran. It would be really helpful if we cached the current state of the test files at the beginning of running the tests so that they don't change during execution.