Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-788

pegasus-s3 cp s3:// to s3:// does not support files > 5GB

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Critical
    • Resolution: Done
    • Affects Version/s: master, 4.4.0, 4.5.0
    • Fix Version/s: master, 4.5.0
    • Labels:
      None

      Description

      pegasus-s3 fails when transferring file/key from s3 source to s3 dest when the src file is > 5GB

      Error Log:

      boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request
      <Error><Code>InvalidRequest</Code><Message>The specified copy source is larger than the maximum allowable size for a copy source: 5368709120</Message><RequestId>6A676A5A2E6B3668</RequestId><HostId>C6doHH6cT7K6k4SgFyv/oU/km+m0bcYyum6ruFKMAiDZ58qW7k0na5DdSoXNs7sZ</HostId></Error>

      Possible Solution:

      http://stackoverflow.com/questions/10355941/how-can-i-copy-files-bigger-than-5-gb-in-amazon-s3

        Attachments

          Activity

            People

            • Assignee:
              gideon Gideon Juve (Inactive)
              Reporter:
              mayani Rajiv Mayani
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: