Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-493 Pegasus Lite incorporation and new data model.
  3. PM-497

staging of worker package for non shared filesystem setup

XMLWordPrintable

    • Type: Icon: Sub-task Sub-task
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • master, 4.0
    • Affects Version/s: master, 4.0
    • Component/s: Pegasus Planner
    • None

      In addition, to a job launched via Pegasus lite, the planner needs to come up with a way to stage the worker package for the jobs in case of non shared filesystem.

      Related to 495/496, but may also involve changes as to how worker package staging is handled for shared filesystem .

      For 3.2 the worker package staging will be implemented as follows for Pegasus Lite case

      • worker package is staged to the submit directory. There is a stage_worker job that does that. However, unlike the shared filesystem setup no untag jobs will be added to the workflow
      • The worker package is then staged with job using Condor IO
      • no cleanup job is added to remove the worker package

      To enable worker package staging
      pegasus.transfer.worker.package true

      Even when worker package transfer is enabled if for a site, PEGASUS_HOME is defined then worker package is not staged from the submit directory with the job.

            Assignee:
            mayani Rajiv Mayani
            Reporter:
            vahi Karan Vahi
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: