When the build_metrics tool was rolled out, it depended on the jsonschema Python module. The requirement was put in etc/pip/components/build_metrics.req which is included by etc/pip/toolchain-requirements.txt. Unfortunately, this means that only Evergreen is actually adding the module to its venv - developers would instead use either etc/pip/compile-requirements.txt or etc/pip/dev-requirements.txt.

We already have SERVER-71268 as a larger effort to simplify the Python requirements files. In the meantime, we should add etc/pip/components/build_metrics.req to etc/pip/compile-requirements.txt and etc/pip/dev-requirements.txt so it does not interfere with developer workflows.