-
Type: Improvement
-
Resolution: Fixed
-
Priority: Major
-
Affects Version/s: master, 4.6.1
-
Component/s: Pegasus Planner
-
None
The issue still exists with running on the OSG that there's not way to tell Pegasus that the osg-site-scratch and local-site-scratch directories actually exist on the same machine. So Pegasus overloads the machine gridftp-ing data from one directory to another on the same machine. Currently users have to manually patch the planned workflow to get around this with something like
cd main_ID0000001
perl pi.bak -e 's+file:///home+symlink:///home+g' stage_inter_local_hdf_trigger_merge*in
perl pi.bak2 -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_inter_local_hdf_trigger_merge*in
perl -pi.bak -e 's+gsiftp://sugar-dev2.phy.syr.edu/home+file:///home+g' stage_out_local_osg-scratch_*in
to symlink rather than gridftp. Would it be possible to fix pegasus so that we don't have to do this?