[SERVER-70480] Apparent rate-limiting on building package test containers Created: 11/Oct/22  Updated: 29/Oct/23  Resolved: 06/Dec/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.3.0-rc0

Type: Bug Priority: Major - P3
Reporter: Ryan Egesdahl (Inactive) Assignee: Ryan Egesdahl (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
is related to SERVER-70121 Ubuntu 18 packaging tests shows error... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:

 Description   

We seem to be sometimes seeing an effect of rate-limiting on building Docker containers for package tests, as can be seen here:

https://evergreen.mongodb.com/task_log_raw/mongodb_mongo_master_nightly_debian11_test_packages_patch_fff51c4b07573c2d27ebccdd4bbe2c722fb7b45e_63459dda9ccd4e753acec7b1_22_10_11_16_46_36/0?type=T&text=true

The debian:11-slim image definitely exists. The error appears to be from the perspective of the docker Python SDK client connecting to the daemon on localhost, so it's probably not able to pull the debian:11-slim image from Docker hub. We probably need to log in with our corporate credentials before building these containers so we're not subject to rate-limiting.



 Comments   
Comment by Githook User [ 06/Dec/22 ]

Author:

{'name': 'Ryan Egesdahl', 'email': 'ryan.egesdahl@mongodb.com', 'username': 'deriamis'}

Message: SERVER-70480 Log in to docker for package tests
Branch: master
https://github.com/mongodb/mongo/commit/81082c7531458ec07602faced625c9f12cff2cf2

Comment by Ryan Egesdahl (Inactive) [ 19/Oct/22 ]

I added the credentials an implemented docker login, but the 404 errors continued. Last night, I found this long-standing bug report: https://github.com/docker/docker-py/issues/2101

I think I’ll have to implement a retry mechanism in our code to work around this problem. Everything I’ve done so far works towards that goal, so no time lost.

Generated at Thu Feb 08 06:16:17 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.