Uploaded image for project: 'Drivers'
  1. Drivers
  2. DRIVERS-2625

drivers-evergreen-tools curl: (18) transfer closed with X bytes

XMLWordPrintableJSON

    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • None
    • Component/s: Evergreen Tools
    • Labels:
      None
    • Not Needed

      The download script occasionally fails with this type of error: "curl: (18) transfer closed with X bytes", for example"

       [2023/05/08 20:00:48.612] linux-rhel-8.4-x86_64
 [2023/05/08 20:00:48.612] http://downloads.10gen.com/linux/mongodb-linux-x86_64-enterprise-rhel80-7.0.0-rc0.tgz
 [2023/05/08 20:00:49.494] curl: (18) transfer closed with 116339528 bytes remaining to read
 [2023/05/08 20:00:49.494] Command 'shell.exec' in function 'bootstrap mongo-orchestration' failed: shell script encountered problem: exit code 18.

      https://spruce.mongodb.com/task/mongo_python_driver_tests_python_version_rhel8.4_test_ssl__platform~rhel84_auth_ssl~auth_ssl_python_version~3.10_coverage~coverage_test_7.0_standalone_patch_873032660bf22d09cbf0013f6b077196d0b95f40_645953c55623436242ec5d39_23_05_08_19_55_49/logs?execution=0&logtype=task&sortBy=STATUS&sortDir=ASC

      The problem is that this type of error isn't retried by default. We need to use the --retry-all-errors flag: https://everything.curl.dev/usingcurl/downloads/retry#retry-on-any-and-all-errors

      This flag is a fairly recent addition in curl 7.71 released June 24 2020:

      Fixed in 7.71.0 - June 24 2020
Changes:
...
- tool: Add option --retry-all-errors to retry on any error

      https://curl.se/changes.html

      We'll need to add this flag in a way that doesn't break if some of the curl versions in EVG are <7.71.

            Assignee:
            shane.harvey@mongodb.com Shane Harvey
            Reporter:
            shane.harvey@mongodb.com Shane Harvey
            Steve Silvester Steve Silvester
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: