With ae959cb0ae92e5195b6e9f358e1096e05f91628c, the build phase is already wrapped in a retry, protecting from a non-deterministic compile failure.
Outside of that, the retry of the `bazel test` invocation causes more problems that it fixes. If the invocation times out because the remote execution cluster is saturated, a retry only further increases load on the cluster.