s_all is currently not running properly in Evergreen. It's failing early on with s_all: 71: evergreen: not found. For some reason, despite the task running s_all with the -E flag, it's exiting with a zero return value (or perhaps there's some other reason the error is ignored).
The scope of this ticket is to fix the root "evergreen not found" issue and make s_all return a non-zero value when that happens.