[SERVER-77608] Use experimental durable storage for published artifacts Created: 30/May/23  Updated: 29/Oct/23  Resolved: 10/Jul/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.0.0-rc7

Type: Task Priority: Major - P3
Reporter: Dylan Richardson Assignee: Dylan Richardson
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Assigned Teams:
Release Infrastructure
Backwards Compatibility: Fully Compatible
Backport Requested:
v7.0
Participants:

 Description   

We would like to try augmenting the server push and publish_packages tasks by immutably saving produced files to an Object-lock backed bucket instead of build-push-testing/mci-uploads. Errors in this process should not fail the task. We want to do this to see how things go and in the future propose re-writing the push and publish_packages tasks to reference durable storage instead of those other buckets.



 Comments   
Comment by Githook User [ 06/Jul/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: add durable storage upload to .publish tasks
Branch: v7.0
https://github.com/mongodb/mongo/commit/6556633c36d3407d94508e64778d8f09b6955835

Comment by Githook User [ 22/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: prefix upload-lock artifacts with version_id
Branch: master
https://github.com/mongodb/mongo/commit/cf8d2f0b9bab5cc7da94e1d837b1b8ee4121e4ae

Comment by Githook User [ 20/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: swap build_id and push paths in upload-lock
Branch: master
https://github.com/mongodb/mongo/commit/ccfca49344afae29aa2080773665691b115cc967

Comment by Githook User [ 20/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: simplify upload-lock destination paths
Branch: master
https://github.com/mongodb/mongo/commit/f7cea93898d88200ad52387b9ae61a892468836e

Comment by Githook User [ 15/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: fix upload-lock command invocation
Branch: master
https://github.com/mongodb/mongo/commit/e5606ee528aa40c94c8ce2d883366e45142623ba

Comment by Githook User [ 15/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: log into Artifactory before publishing packages
Branch: master
https://github.com/mongodb/mongo/commit/017daca262e8adff9b4dec2fd84a7f8498ad7c64

Comment by Githook User [ 13/Jun/23 ]

Author:

{'name': 'dylrich', 'email': 'dylan.richardson@mongodb.com', 'username': 'dylrich'}

Message: SERVER-77608: add durable storage upload to .publish tasks
Branch: master
https://github.com/mongodb/mongo/commit/cc2f6d163820ace0d4c22a578c9081285fddb5bf

Generated at Thu Feb 08 06:36:05 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.