Downloading worker via https does not work

XMLWordPrintable

    • Type: Bug
    • Resolution: Won't Fix
    • Priority: Major
    • None
    • Affects Version/s: None
    • Component/s: pegasus-kickstart
    • None

      The pegasus lite fallback of downloading the worker package via http does not seem to work in 4.7.1 or 4.8.0dev. It looks like PYTHONPATH is not being set correctly. Using the worker from CVMFS works fine.

      Startup: Sat Nov 12 18:21:30 EST 2016
      Node: CRUSH-OSG-LIGO-10-5-143-12
      Site: SU-OG
      PilotID: Name = "glidein_2_136865604@CRUSH-OSG-LIGO-10-5-143-12"
      Using CVMFS for LAL data
      Using /cvmfs/oasis.opensciencegrid.org/ligo/deploy/sw/pycbc/lalsuite-extra/8/share/lalsimulation for LAL_DATA_PATH
      Sourcing the cvmfs script : /cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/3.3/current/el7-x86_64/setup.sh
      Enviroment variables after sourcing the osg setup script
      LD_LIBRARY_PATH: /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib64/lcgdm:/usr/lib
      X509_CERT_DIR: /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/etc/grid-security/certificates
      GFAL_PLUGIN_DIR: /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib64/gfal2-plugins/
      GFAL_CONFIG_DIR: /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/etc/gfal2.d/
      PYTHONPATH: /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.18/el7-x86_64/usr/lib64/python2.7/site-packages:/home/lorena.magana-zertuche/pycbcv1.5.5/opt/lalsuite/lib64/python2.7/site-packages:/home/lorena.magana-zertuche/pycbcv1.5.5/opt/lalsuite/lib/python2.7/site-packages:
      2016-11-12 18:21:30: PegasusLite: version 4.8.0dev
      2016-11-12 18:21:30: Executing on host sugwg-osg.phy.syr.edu OSG_SITE_NAME=SU-OG-CE1 GLIDEIN_Site=SU-OG GLIDEIN_Site=SU-OG-CE1

                                                                    1. Setting up workdir ################################
                                                                      2016-11-12 18:21:30: Checking /var/lib/condor/execute/dir_1528324/glide_E5tXPe/execute/dir_10054 for potential use as work space...
                                                                      2016-11-12 18:21:30: Work dir is /var/lib/condor/execute/dir_1528324/glide_E5tXPe/execute/dir_10054/pegasus.GjXSfn - 188735500 kB available
                                                1. figuring out the worker package to use ######################
                                                  2016-11-12 18:21:30: Warning: Pegasus binaries in /usr/bin do not match Pegasus version used for current workflow
                                                  2016-11-12 18:21:30: Downloading Pegasus worker package from http://download.pegasus.isi.edu/pegasus/4.8.0dev/pegasus-worker-4.8.0dev-x86_64_rhel_7.tar.gz
                                                1. staging in input data and executables ######################
                                                  ImportError: No module named site
                                                  2016-11-12 18:21:32: Last command exited with 1
                                                  2016-11-12 18:21:32: /var/lib/condor/execute/dir_1528324/glide_E5tXPe/execute/dir_10054/pegasus.GjXSfn cleaned up
                                                  PegasusLite: exitcode 1

            Assignee:
            Gideon Juve (Inactive)
            Reporter:
            Duncan Brown
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: