Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1378

Handle (copy) HPSS credentials when an environment variable is set


    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • 5.0.0, 4.9.2
    • Affects Version/s: master, 4.9.1
    • Component/s: CLI: pegasus-transfer
    • None

      We need to handle the local HPSS credentials and copy them to the currently set $HOME directory.

      Info: At NERSC a ".netrc" file exists in user's home directory and contains the HPSS credentials. This file is created automatically after the user authenticates for the first time on HPSS. While connecting to HPSS, hsi and htar commands look first for the $HOME/.netrc file to get the HPSS token and if it doesn't exist prompt for the user's password.

      Issue: BLAH changes the $HOME variable to the scratch home folder it creates and this prevents hsi and htar to locate the .netrc file.

      Proposed solution: An environment variable (eg. PEGASUS_TRANSFER_HPSS_CREDENTIAL or HPSS_CREDENTIAL) could exist during pegasus-transfer invocation, containing the absolute path of the .netrc file (eg. global/homes/p/papajim/.netrc). pegasus-transfer should check for this variable and if it is set should verify the .netrc file exists and copy it to the current $HOME location. If the file doesn't exist pegasus-transfer should print an appropriate message on its output.

            vahi Karan Vahi
            georgpap George Papadimitriou
            2 Start watching this issue