[SERVER-78394] Prototype backup/restore of a dsi atlas cluster Created: 23/Jun/23  Updated: 26/Jul/23  Resolved: 26/Jul/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Lamont Nelson Assignee: Jason Zhang
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Sprint: Sharding NYC 2023-06-26, Sharding NYC 2023-07-10, Sharding NYC 2023-07-24, Sharding NYC 2023-08-07
Participants:

 Description   

Some of these may be able to just be answered via a conversation, but the output for this ticket should just be a simple script that programmatically takes a backup of an existing cluster created by DSI in Atlas and restores it to another cluster in Atlas. Some auxiliary information that we want to know is:

1. What is the authentication mechanism that dsi uses to interact with the atlas dev environment. Where is this information stored? Is it encrypted?
2. How are multiple snapshots uniquely identified? Are these snapshots tied to a particular project in Atlas?
3. What are the terraform or atlas api invocations (links to the code) that enable this functionality?
4. Any unexpected roadblocks to programmatically using this feature?
5. As a developer, do we have sufficient permissions to do this?



 Comments   
Comment by Jason Zhang [ 26/Jul/23 ]

Some observations:

  • Snapshots for a 1TB sharded cluster can take approximately 5-10 minutes.
  • Restoring from a backup for a TB sharded cluster can take approximately 45minutes to 1 hr.
  • We can spin up multiple clusters and restore from a single backup.

Will close this ticket since all of the open questions have been answered.

Comment by Lamont Nelson [ 20/Jul/23 ]

Re-opening as we'll want some initial timing data about the restore functionality.

Generated at Thu Feb 08 06:38:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.