pegasus-s3 to be able to download all files in a folder

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

    • Type: New Feature
    • Resolution: Fixed
    • Priority: Major
    • master, 4.7.0, 4.6.1
    • Affects Version/s: master, 4.6.0
    • Component/s: CLI: pegasus-s3
    • None

      We have a user request from Steve Buyske

      It worked very nicely. Is there a way to copy the whole directory (i.e., not file by file)? My various attempts to do so did not succeed.

      Steve

      Basically, he would like to be able to upload all files in a local folder to pegasus-s3 bucket space, and download all files then from that folder in s3 in a single invocation. Note: the word folder, is what S3 web console refers to as a folder

      For example, he would like to be able to do something as follows
      pegasus-s3 get -C ~/s3cfg s3://[USERNAME]@amazon/page-bootcamp/simulated-data/ /tmp/

      And all files with the prefix /page-bootcamp/simulated-data/ get downloaded to /tmp

      If possible, can we try to have it for 4.6.1

            Assignee:
            Gideon Juve
            Reporter:
            Karan Vahi
            Archiver:
            Rajiv Mayani

              Created:
              Updated:
              Resolved:
              Archived: