Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1064

pegasus-transfer prepends to PATH

XMLWordPrintable

      Hi Karan, Mats,

      In our site catalog we have

      <profile namespace="env" key="PATH">/cvmfs/oasis.opensciencegrid.org/osg/modules/gcc/4.9.3/bin:/cvmfs/oasis.opensciencegrid.org/osg/modules/python-2.7.7/bin:/cvmfs/oasis.opensciencegrid.org/osg/modules/lua/bin:/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin</profile>

      In particular, we need the version of gfal-copy that lives in /cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/bin. However in a recent run

      <https://sugar-dev2.phy.syr.edu/pegasus/u/lppekows/r/69/w/2/j/628/ji/194>

      at sites that have gfal-copy in /usr/bin the transfer is using it:

      PilotID: Name = "glidein_11953_727322296@hansen-a050.rcac.purdue.edu”
      […]
      2016-02-18 16:32:31,252 INFO: Tool found: gfal-copy Version: 2.10.3 Path: /usr/bin/gfal-copy
      2016-02-18 16:32:31,253 INFO: gfal-copy -f 'root://srm.unl.edu//user/ligo/frames/O1/H1_HOFT_C00/H1/H-H1_HOFT_C00-1128/H-H1_HOFT_C00-1128468480-4096.gwf' 'file:///var/condor/execute/dir_11668/glide_PVQVbo/execute/dir_41472/pegasus.U16HQd/112846/H-H1_HOFT_C00-1128468480-4096.gwf'
      Traceback (most recent call last):
      File "/usr/bin/gfal-copy", line 12, in
      sys.exit(Gfal2Shell().main(sys.argv))
      File "/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/lib/python2.6/site-packages/gfal2_util/shell.py", line 71, in main
      return inst.execute(command_func)
      File "/cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.2/current/el6-x86_64/usr/lib/python2.6/site-packages/gfal2_util/base.py", line 143, in execute
      self.context.set_user_agent("gfal2-util", VERSION)
      AttributeError: 'Gfal2Context' object has no attribute ‘set_user_agent'

      I see that at line 430 pegasus-transfer does

      1. figure out the full path to the executable
        full_path = backticks("which " + executable + " 2>/dev/null”)

      So I don’t see why it isn’t finding the preferred version, unless the PATH somehow isn’t getting picked up properly. Is that possible?

      Thanks,

      • Larne

            Assignee:
            rynge Mats Rynge
            Reporter:
            dbrown Duncan Brown
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: