Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1108

ability to indicate to pegasus that directories for two sites are actually on the same machine

XMLWordPrintable

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • master, 4.7.0, 4.6.2
    • Affects Version/s: master, 4.6.1
    • Component/s: Pegasus Planner
    • None

      The issue still exists with running on the OSG that there's not way to tell Pegasus that the osg-site-scratch and local-site-scratch directories actually exist on the same machine. So Pegasus overloads the machine gridftp-ing data from one directory to another on the same machine. Currently users have to manually patch the planned workflow to get around this with something like

      cd main_ID0000001
      perl pi.bak -e 's+file:///home+symlink:///home+g' stage_inter_local_hdf_trigger_merge*in
      perl pi.bak2 -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_inter_local_hdf_trigger_merge*in
      perl -pi.bak -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_out_local_osg-scratch_*in

      to symlink rather than gridftp. Would it be possible to fix pegasus so that we don't have to do this?

            Assignee:
            vahi Karan Vahi
            Reporter:
            dbrown Duncan Brown
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: