Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1064

pegasus-transfer prepends to PATH

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 4.6.1
    • Fix Version/s: master, 4.7.0, 4.6.1
    • Component/s: pegasus-transfer
    • Labels:
      None

      Description

      Hi Karan, Mats,

      In our site catalog we have

         <profile namespace="env" key="PATH">/cvmfs/oasis.opensciencegrid.org/osg/modules/gcc/4.9.3/bin:/cvmfs/oasis.opensciencegrid.org/osg/modules/python-2.7.7/bin:/cvmfs/oasis.opensciencegrid.org/osg/modules/lua/bin:/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin</profile>

      In particular, we need the version of gfal-copy that lives in /cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/bin. However in a recent run

       <https://sugar-dev2.phy.syr.edu/pegasus/u/lppekows/r/69/w/2/j/628/ji/194>

      at sites that have gfal-copy in /usr/bin the transfer is using it:

       PilotID: Name = "glidein_11953_727322296@hansen-a050.rcac.purdue.edu
       […]
       2016-02-18 16:32:31,252 INFO: Tool found: gfal-copy Version: 2.10.3 Path: /usr/bin/gfal-copy
       2016-02-18 16:32:31,253 INFO: gfal-copy -f 'root://srm.unl.edu//user/ligo/frames/O1/H1_HOFT_C00/H1/H-H1_HOFT_C00-1128/H-H1_HOFT_C00-1128468480-4096.gwf&#39; 'file:///var/condor/execute/dir_11668/glide_PVQVbo/execute/dir_41472/pegasus.U16HQd/112846/H-H1_HOFT_C00-1128468480-4096.gwf&#39;
       Traceback (most recent call last):
         File "/usr/bin/gfal-copy", line 12, in
           sys.exit(Gfal2Shell().main(sys.argv))
         File "/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/lib/python2.6/site-packages/gfal2_util/shell.py", line 71, in main
           return inst.execute(command_func)
        File "/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/lib/python2.6/site-packages/gfal2_util/base.py", line 143, in execute
           self.context.set_user_agent("gfal2-util", VERSION)
       AttributeError: 'Gfal2Context' object has no attribute ‘set_user_agent'

      I see that at line 430 pegasus-transfer does

                 # figure out the full path to the executable
                 full_path = backticks("which " + executable + " 2>/dev/null”)

      So I don’t see why it isn’t finding the preferred version, unless the PATH somehow isn’t getting picked up properly. Is that possible?

      Thanks,

      - Larne

        Attachments

          Activity

            People

            • Assignee:
              rynge Mats Rynge
              Reporter:
              dbrown Duncan Brown
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: