We added check_binary_version to the test setup so we could bypass the compile step in some situations. However, we no longer do that anymore and this has become an unnecessary check. We can remove it and anything that was being done to prepare for it as well.