Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-794

s3 puts fail to upload large files on slow links

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1
    • Component/s: None
    • Labels:
      None

      Description

      On one of our POWER machines we have an abnormally slow link to s3. The uploads fail with an i/o error and then with a "use of closed network connection" error on each subsequent attempt.

      1. Can the timeout be longer? Using curl takes ~8 minutes to upload the same file to s3 on the same machine.
      2. Can s3.put not try to write the entire file in one write operation so it can still time out if a single call to write() takes longer than 2 minutes, but each write() is smaller?
      3. Can we fix the "use of closed network connection" error?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kyle.erf Kyle Erf
                Reporter:
                jonathan.reams Jonathan Reams
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: