Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-103573

Investigate using multipart S3 download for downloading debug symbols

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Testing Infrastructure
    • None
    • DevProd Correctness
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      There has been great success to use https://docs.aws.amazon.com/sdk-for-go/api/service/s3/s3manager/#NewDownloader to download objects from S3 in concurrent chunks. We should explore doing the same at least for the places where the download sizes are known to be large like with the debug symbol tarballs.

      https://github.com/mongodb/mongo/blob/0a68308f0d39a928ed551f285ba72ca560c38576/evergreen/spawnhost/download_archive_dist_test_debug.py#L74

            Assignee:
            Unassigned Unassigned
            Reporter:
            max.hirschhorn@mongodb.com Max Hirschhorn
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: