I was trying out the commit queue for a project. It looks like the commit queue generated an evergreen version and all the tasks completed successfully, but the PR was not merged. It also didn't update github of the success of the version.
The PR is here: https://github.com/evergreen-ci/evergreen.py/pull/10 (i may manually merge this before you get a change to see it).
The evergreen version is here: https://evergreen.mongodb.com/version/5cb8e67f32f4173adf68c98b