[SERVER-61815] dev-requirements.txt seems to still need 100's of botocore packages Created: 30/Nov/21  Updated: 18/Nov/23  Resolved: 03/Nov/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Eric Milkie Assignee: [DO NOT ASSIGN] Backlog - DevProd Correctness
Resolution: Gone away Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: HTML File log    
Assigned Teams:
Correctness
Operating System: ALL
Participants:
Story Points: 1

 Description   

Today I ran /usr/local/bin/python3 -m pip install -r etc/pip/dev-requirements.txt at the suggestion of the requirements package after a build failure. I was surprised to see it install 100's of botocore packages; this is probably wrong? This command was run at the tip of the master branch as of Nov 29.

I'll attach the full log of what happened.



 Comments   
Comment by Eric Milkie [ 03/Nov/23 ]

I'm pretty sure this has been fixed for myself as well.

Comment by Eric Milkie [ 14/Dec/21 ]

I'm using pip 21.3.1. I'm not too keen on downgrading pip (it's fragile enough as it is..)

Comment by Richard Samuels (Inactive) [ 13/Dec/21 ]

pip is attempting to resolve the version constraint by downloading multiple versions of the botocore, Jinja2, oauthlib, and metadata packages, and testing them against the other requirements. Let's just have a look at what versions of these packages pip accepts, and pin those versions.

milkie Can you activate your venv and run python3 -m pip --version? I'd be curious what pip version you are running. You may see better results by installing the same version of pip and wheel that we use in evergreen: python -m pip --disable-pip-version-check install "pip==21.0.1" "wheel==0.37.0"

Comment by Brooke Miller [ 13/Dec/21 ]

Looks like we're using botocore for kms. We're going to figure out which packages are necessary and which ones are not needed to be installed. We'll tentatively slate this in as a quick-win for next quarter. 

Generated at Thu Feb 08 05:53:23 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.