Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-686

external URL for executables staged are created incorrectly for SRM servers

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 4.2
    • Fix Version/s: master, 4.2.1, 4.3
    • Component/s: Pegasus Planner
    • Labels:
      None

      Description

      I have a site catalog as follows

      <?xml version="1.0" encoding="UTF-8"?>
      <sitecatalog xmlns="http://pegasus.isi.edu/schema/sitecatalog" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://pegasus.isi.edu/schema/sitecatalog http://pegasus.isi.edu/schema/sc-4.0.xsd" version="4.0">

          <site handle="local" arch="x86" os="LINUX">
              <directory type="shared-scratch" path="/data/scratch/vahi/work/creamce/test/creamce-sharedfs/work">
                  <file-server operation="all" url="file:///data/scratch/vahi/work/creamce/test/creamce-sharedfs/work"/>
              </directory>
              <directory type="local-storage" path="/data/scratch/vahi/work/creamce/test/creamce-sharedfs/outputs">
                  <file-server operation="all" url="file:///data/scratch/vahi/work/creamce/test/creamce-sharedfs/outputs"/>
              </directory>
              <profile namespace="condor" key="getenv">true</profile>
          </site>

          <site handle="creamce" arch="x86" os="LINUX">
              <grid type="cream" contact="https://ce01-lcg.cr.cnaf.infn.it:8443/ce-cream/services/CREAM2" scheduler="LSF" jobtype="compute" />
              <grid type="cream" contact="https://ce01-lcg.cr.cnaf.infn.it:8443/ce-cream/services/CREAM2" scheduler="LSF" jobtype="auxillary" />

              <directory type="shared-scratch" path="/storage/gpfs_virgo3/">
                  <!-- <file-server operation="all" url="gsiftp://ce01-lcg.cr.cnaf.infn.it/home/virgo034/virgo"/>
                  <file-server operation="all" url="gsiftp://gridftp-storm-archive.cr.cnaf.infn.it/storage/gpfs_virgo3/virgo"/> -->
                   
                     <file-server operation="all" url="srm://storm-fe-archive.cr.cnaf.infn.it:8444/srm/managerv2?SFN=/virgo3/"/>
              </directory>
              
              <profile namespace="pegasus" key="style">cream</profile>
              <profile namespace="globus" key="queue">virgo</profile>
              <profile namespace="env" key="PEGASUS_HOME">/storage/gpfs_virgo3/virgo/pegasus-4.2.0-cvs</profile>
          </site>

      </sitecatalog>

      My stagein jobs failed because the URL for executables staged was incorrect
      vahi@obelix:/data/scratch/vahi/work/creamce/test/creamce-sharedfs/work/vahi/pegasus/blackdiamond/run0021$ more stage_in_local_creamce_0_0.in
      # src 1 local prio 0
      file:///data/scratch/vahi/work/creamce/test/creamce-sharedfs/f.a
      # dst 1 creamce
      srm://storm-fe-archive.cr.cnaf.infn.it:8444/srm/managerv2?SFN=/virgo3//vahi/pegasus/blackdiamond/run0021/f.a
      # src 2 local prio 0
      file:///data/scratch/vahi/work/creamce/test/creamce-condorio/pegasus-4.2.0-cvs/bin/pegasus-keg
      # dst 2 creamce
      srm://storm-fe-archive.cr.cnaf.infn.it:8444/storage/gpfs_virgo3/vahi/pegasus/blackdiamond/run0021/pegasus-preprocess-4.0

      The destination url for pegasus-preprocess-4.0 is incorrect.

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              vahi Karan Vahi
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: