Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1108

ability to indicate to pegasus that directories for two sites are actually on the same machine

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 4.6.1
    • Fix Version/s: master, 4.7.0, 4.6.2
    • Component/s: pegasus-plan
    • Labels:
      None

      Description

      The issue still exists with running on the OSG that there's not way to tell Pegasus that the osg-site-scratch and local-site-scratch directories actually exist on the same machine. So Pegasus overloads the machine gridftp-ing data from one directory to another on the same machine. Currently users have to manually patch the planned workflow to get around this with something like

      cd main_ID0000001
      perl -pi.bak -e 's+file:///home+symlink:///home+g' stage_inter_local_hdf_trigger_merge-*in
      perl -pi.bak2 -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_inter_local_hdf_trigger_merge-*in
      perl -pi.bak -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_out_local_osg-scratch_*in

      to symlink rather than gridftp. Would it be possible to fix pegasus so that we don't have to do this?

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              dbrown Duncan Brown
            • Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: