[2022/12/06 07:50:10.897] --------------------------------------------------------------------------------
 [2022/12/06 07:50:10.897] |                           Starting workload_setup                            |
 [2022/12/06 07:50:10.897] --------------------------------------------------------------------------------
 [2022/12/06 07:50:10.897] 
 [2022/12/06 07:50:10.899] 2022-12-06T07:50:10Z [info ] [dsi.cli                    ] Running DSI operation invocation=['run-dsi', 'run_workload'] op_uuid=f962970b operation=workload_setup
 [2022/12/06 07:50:11.073] 2022-12-06T07:50:11Z [info ] [dsi.config.config          ] Loaded DSI config    config_root=/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf loaded_files=['/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/bootstrap.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/bootstrap/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/runtime.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/runtime_secret.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/infrastructure_provisioning.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/infrastructure_provisioning/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/workload_setup.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/workload_setup/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/mongodb_setup.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/mongodb_setup/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/test_control.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/test_control/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/analysis.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/configurations/analysis/defaults.original.yml', '/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/overrides.yml']
 [2022/12/06 07:50:11.076] 2022-12-06T07:50:11Z [info ] [dsi.workload_setup         ] Starting workload_setup setup_type=genny
 [2022/12/06 07:50:11.077] 2022-12-06T07:50:11Z [info ] [dsi.host.command_runner    ] Running command      command=['ensure_repos'] on_host=localhost
 [2022/12/06 07:50:11.095] 07:50:11Z>  # Not currently on any branch.
 [2022/12/06 07:50:11.095] 07:50:11Z>  nothing to commit (working directory clean)
 [2022/12/06 07:50:11.114] 2022-12-06T07:50:11Z [info ] [dsi.host.base_host         ] Directory 'src/genny' is a git repository with ref '2184d762ed8e66f851b07e91c28fe42db1334a69' checked out, but was expecting 'master'. expected_ref=master local_ref=2184d762ed8e66f851b07e91c28fe42db1334a69 target=src/genny
 [2022/12/06 07:50:11.178] 2022-12-06T07:50:11Z [info ] [dsi.host.command_runner    ] Executing command    command=set -euo pipefail\n# ... on_host=workload_client
 [2022/12/06 07:50:11.280] 2022-12-06T07:50:11Z [info ] [dsi.host.command_runner    ] Executing command    command=set -eou pipefail\nmk... on_host=workload_client
 [2022/12/06 07:50:11.306] 07:50:11Z>  You are already inside a virtual environment /srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/dsi_venv.
 [2022/12/06 07:50:11.306] 07:50:11Z>  This can be problematic. Will try to proceed, but the operation may fail.
 [2022/12/06 07:50:11.306] 07:50:11Z>  If it does, please deactivate your existing virtualenv first:
 [2022/12/06 07:50:11.307] 07:50:11Z> 
 [2022/12/06 07:50:11.307] 07:50:11Z>      deactivate
 [2022/12/06 07:50:11.307] 07:50:11Z> 
 [2022/12/06 07:50:11.307] 07:50:11Z>  If you're stuck, please reach out to the #performance-tooling-users MongoDB slack channel and paste this output.
 [2022/12/06 07:50:11.307] 07:50:11Z> 
 [2022/12/06 07:50:11.307] 07:50:11Z>  fatal: Not a git repository (or any of the parent directories): .git
 [2022/12/06 07:50:11.307] 07:50:11Z>    git rev-parse HEAD:
 [2022/12/06 07:50:11.307] 07:50:11Z>    uname -a:           Linux build.ny.cbi.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
 [2022/12/06 07:50:11.308] 07:50:11Z>    whoami:             mci-perf-exec
 [2022/12/06 07:50:11.308] 07:50:11Z>    command -v python3: /opt/mongodbtoolchain/v3/bin/python3
 [2022/12/06 07:50:11.309] 07:50:11Z>    pwd:                /srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf
 [2022/12/06 07:50:11.309] 07:50:11Z>    PATH:               /opt/mongodbtoolchain/v3/bin:/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/dsi_venv/bin:/opt/python3/bin:/opt/mongodbtoolchain/v3/bin:/opt/go/bin:/usr/local/bin:/bin:/usr/bin
 [2022/12/06 07:50:25.157] 07:50:25Z>  [debug] [genny.download      ] Downloading          name=curator timestamp=2022-12-06T07:50:25Z url=https://s3.amazonaws.com/boxes.10gen.com/build/curator/curator-dist-rhel70-3df28d2514d4c4de7c903d027e43f3ee48bf8ec1.tar.gz
 [2022/12/06 07:50:25.189] 07:50:25Z> 
 [2022/12/06 07:50:25.189] 07:50:25Z> 
 [2022/12/06 07:50:25.189] 07:50:25Z>  Traceback (most recent call last):
 [2022/12/06 07:50:25.200] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 1317, in do_open
 [2022/12/06 07:50:25.201] 07:50:25Z>      encode_chunked=req.has_header('Transfer-encoding'))
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 1229, in request
 [2022/12/06 07:50:25.201] 07:50:25Z>      self._send_request(method, url, body, headers, encode_chunked)
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 1275, in _send_request
 [2022/12/06 07:50:25.201] 07:50:25Z>      self.endheaders(body, encode_chunked=encode_chunked)
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 1224, in endheaders
 [2022/12/06 07:50:25.201] 07:50:25Z>      self._send_output(message_body, encode_chunked=encode_chunked)
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 1016, in _send_output
 [2022/12/06 07:50:25.201] 07:50:25Z>      self.send(msg)
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 956, in send
 [2022/12/06 07:50:25.201] 07:50:25Z>      self.connect()
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/http/client.py", line 1392, in connect
 [2022/12/06 07:50:25.201] 07:50:25Z>      server_hostname=server_hostname)
 [2022/12/06 07:50:25.201] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/ssl.py", line 412, in wrap_socket
 [2022/12/06 07:50:25.202] 07:50:25Z>      session=session
 [2022/12/06 07:50:25.202] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/ssl.py", line 853, in _create
 [2022/12/06 07:50:25.202] 07:50:25Z>      self.do_handshake()
 [2022/12/06 07:50:25.202] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/ssl.py", line 1117, in do_handshake
 [2022/12/06 07:50:25.202] 07:50:25Z>      self._sslobj.do_handshake()
 [2022/12/06 07:50:25.202] 07:50:25Z>  ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1056)
 [2022/12/06 07:50:25.202] 07:50:25Z> 
 [2022/12/06 07:50:25.202] 07:50:25Z>  During handling of the above exception, another exception occurred:
 [2022/12/06 07:50:25.202] 07:50:25Z> 
 [2022/12/06 07:50:25.202] 07:50:25Z>  Traceback (most recent call last):
 [2022/12/06 07:50:25.202] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/src/lamplib/src/genny/cli.py", line 548, in <module>
 [2022/12/06 07:50:25.202] 07:50:25Z>      cli()
 [2022/12/06 07:50:25.202] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/core.py", line 829, in __call__
 [2022/12/06 07:50:25.202] 07:50:25Z>      return self.main(*args, **kwargs)
 [2022/12/06 07:50:25.202] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/core.py", line 782, in main
 [2022/12/06 07:50:25.203] 07:50:25Z>      rv = self.invoke(ctx)
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
 [2022/12/06 07:50:25.203] 07:50:25Z>      return _process_result(sub_ctx.command.invoke(sub_ctx))
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
 [2022/12/06 07:50:25.203] 07:50:25Z>      return ctx.invoke(self.callback, **ctx.params)
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke
 [2022/12/06 07:50:25.203] 07:50:25Z>      return callback(*args, **kwargs)
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/genny_venv/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func
 [2022/12/06 07:50:25.203] 07:50:25Z>      return f(get_current_context(), *args, **kwargs)
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/src/lamplib/src/genny/cli.py", line 121, in cmake_compile_install
 [2022/12/06 07:50:25.203] 07:50:25Z>      linux_distro=linux_distro,
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/src/lamplib/src/genny/curator.py", line 178, in ensure_curator_installed
 [2022/12/06 07:50:25.203] 07:50:25Z>      downloader.fetch_and_install()
 [2022/12/06 07:50:25.203] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/src/lamplib/src/genny/download.py", line 54, in fetch_and_install
 [2022/12/06 07:50:25.204] 07:50:25Z>      self._fetch_and_install_impl()
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/genny/src/lamplib/src/genny/download.py", line 103, in _fetch_and_install_impl
 [2022/12/06 07:50:25.204] 07:50:25Z>      urllib.request.urlretrieve(url, tarball)
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 247, in urlretrieve
 [2022/12/06 07:50:25.204] 07:50:25Z>      with contextlib.closing(urlopen(url, data)) as fp:
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 222, in urlopen
 [2022/12/06 07:50:25.204] 07:50:25Z>      return opener.open(url, data, timeout)
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 525, in open
 [2022/12/06 07:50:25.204] 07:50:25Z>      response = self._open(req, data)
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 543, in _open
 [2022/12/06 07:50:25.204] 07:50:25Z>      '_open', req)
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 503, in _call_chain
 [2022/12/06 07:50:25.204] 07:50:25Z>      result = func(*args)
 [2022/12/06 07:50:25.204] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 1360, in https_open
 [2022/12/06 07:50:25.204] 07:50:25Z>      context=self._context, check_hostname=self._check_hostname)
 [2022/12/06 07:50:25.205] 07:50:25Z>    File "/opt/mongodbtoolchain/revisions/ecdb6f23a2cc2e822b8dc2eeb3f04c31f25c66ce/stow/python3-v3.giT/lib/python3.7/urllib/request.py", line 1319, in do_open
 [2022/12/06 07:50:25.205] 07:50:25Z>      raise URLError(err)
 [2022/12/06 07:50:25.205] 07:50:25Z>  urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1056)>
 [2022/12/06 07:50:25.205] 2022-12-06T07:50:25Z [warning] [dsi.host.local_host        ] Failed               alias=workload_client.0 command=set -eou pipefail
 [2022/12/06 07:50:25.205] mkdir -p /data/mci
 [2022/12/06 07:50:25.205] # TODO(TIG-2677): don't rely on tfvars
 [2022/12/06 07:50:25.205] if [[ "microbenchmarks" == "centos7" ]]; then
 [2022/12/06 07:50:25.205]   distro="rhel70";
 [2022/12/06 07:50:25.205] elif [[ "microbenchmarks" == "microbenchmarks" ]]; then
 [2022/12/06 07:50:25.205]   distro=rhel62
 [2022/12/06 07:50:25.205] else
 [2022/12/06 07:50:25.205]   distro="amazon2";
 [2022/12/06 07:50:25.205] fi
 [2022/12/06 07:50:25.205] ./src/genny/run-genny -v install --linux-distro "$distro"
 [2022/12/06 07:50:25.205]  exit_status=1
 [2022/12/06 07:50:25.206] 2022-12-06T07:50:25Z [warning] [dsi.host.thread_runner     ] Unexpected exception in thread command=functools.partial(<function make_host_runner at 0x7f128b83cc10>, HostInfo(127.0.0.1, 127.0.0.1, ec2-user, aws_ssh_key.pem, workload_client, 0, 2022-12-06 13:46:20.867377), {'exec': 'set -eou pipefail
 [2022/12/06 07:50:25.206] mkdir -p /data/mci
 [2022/12/06 07:50:25.206] # TODO(TIG-2677): don't rely on tfvars
 [2022/12/06 07:50:25.206] if [[ "microbenchmarks" == "centos7" ]]; then
 [2022/12/06 07:50:25.206]   distro="rhel70";
 [2022/12/06 07:50:25.206] elif [[ "microbenchmarks" == "microbenchmarks" ]]; then
 [2022/12/06 07:50:25.206]   distro=rhel62
 [2022/12/06 07:50:25.206] else
 [2022/12/06 07:50:25.206]   distro="amazon2";
 [2022/12/06 07:50:25.206] fi
 [2022/12/06 07:50:25.206] ./src/genny/run-genny -v install --linux-distro "$distro"
 [2022/12/06 07:50:25.206] '}, 'workload_setup', MongoDBAuthSettings(mongo_user='username', mongo_password='password'), None)
 [2022/12/06 07:50:25.206] Traceback (most recent call last):
 [2022/12/06 07:50:25.206]   File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/src/dsi/host/thread_runner.py", line 71, in wrap
 [2022/12/06 07:50:25.206]     thread_results.put(command())
 [2022/12/06 07:50:25.206]   File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/src/dsi/host/command_runner.py", line 95, in make_host_runner
 [2022/12/06 07:50:25.206]     _run_host_command_map(target_host, command, prefix)
 [2022/12/06 07:50:25.206]   File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/src/dsi/host/command_runner.py", line 181, in _run_host_command_map
 [2022/12/06 07:50:25.206]     host.host_utils.raise_if_not_success(success, value)
 [2022/12/06 07:50:25.206]   File "/srv/10gen/mci-exec/mci/94a23b80c27c1f0b0fb856c38a43e0cf/src/dsi/src/dsi/host/host_utils.py", line 93, in raise_if_not_success
 [2022/12/06 07:50:25.206]     raise HostException(1, message)
 [2022/12/06 07:50:25.206] dsi.host.host_utils.HostException: (1, 'set -eou pipefail\nmkdir -p /data/mci\n# TODO(TIG-2677): don\'t rely on tfvars\nif [[ "microbenchmarks" == "centos7" ]]; then\n  distro="rhel70";\nelif [[ "microbenchmarks" == "microbenchmarks" ]]; then\n  distro=rhel62\nelse\n  distro="amazon2";\nfi\n\n./src/genny/run-genny -v install --linux-distro "$distro"\n')
 [2022/12/06 07:50:25.298] 2022-12-06T07:50:25Z [info ] [dsi.cli                    ] Finished running DSI operation exit_code=2 invocation=['run-dsi', 'run_workload'] op_uuid=f962970b operation=workload_setup
 [2022/12/06 07:50:25.299] 2022-12-06T07:50:25Z [info ] [dsi.cli                    ] 
 [2022/12/06 07:50:25.299] --------------------------------------------------------------------------------
 [2022/12/06 07:50:25.299] |                    workload_setup completed with failures                    |
 [2022/12/06 07:50:25.299] --------------------------------------------------------------------------------