-
Type: Sub-task
-
Resolution: Fixed
-
Priority: Major
-
Affects Version/s: master, 4.0
-
Component/s: Pegasus Planner
-
None
In addition, to a job launched via Pegasus lite, the planner needs to come up with a way to stage the worker package for the jobs in case of non shared filesystem.
Related to 495/496, but may also involve changes as to how worker package staging is handled for shared filesystem .
For 3.2 the worker package staging will be implemented as follows for Pegasus Lite case
- worker package is staged to the submit directory. There is a stage_worker job that does that. However, unlike the shared filesystem setup no untag jobs will be added to the workflow
- The worker package is then staged with job using Condor IO
- no cleanup job is added to remove the worker package
To enable worker package staging
pegasus.transfer.worker.package true
Even when worker package transfer is enabled if for a site, PEGASUS_HOME is defined then worker package is not staged from the submit directory with the job.