Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-667

Make SubDAX planning prescript run in the scratch directory instead of the dag directory

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0, 4.1, 4.2, 4.1.1
    • Fix Version/s: master, 4.3
    • Component/s: pegasus-plan
    • Labels:
      None

      Description

      The SubDAX planning preSCRIPT currently runs in the DAG directory by default. This requires any job producing SUBDAX related files in the previous job to know the runtime DAG directory location before planning. I propose to move the planning prescript for a subdax job to run in the local scratch directory such that any file required by the planner can be found in the local scratch directory either due to the execution of a previous job in the local scratch directory or due to interpool transfer. The SUB Dags created by the planning can still go into the root DAG directory

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              gmehta Gaurang Mehta (Inactive)
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: