Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1105

Mirror job priorities to DAGMan node priorities

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 4.7.0, 4.6.1
    • Fix Version/s: 4.7.0, 4.6.2
    • Component/s: None
    • Labels:
      None

      Description

      The default job priorities for Pegasus workflows, in which auxiliary jobs such as staging and cleanup jobs gets higher priority, and priority based on level of the workflow, seems to work great in most cases. However, for large workflows using maxidle or maxjobs throttling, the jobs are not submitted in any particular order. Higher priority jobs might be available inside DAGMan while lower priority ones are submitted to the queue.

      I suggest that we mirror the job priority we put in the .sub file to also be set in the DAG. This way the same priority is used for submitting as well as scheduling the jobs.

      For more details on the DAG node priority:
      https://research.cs.wisc.edu/htcondor/manual/v8.4/2_10DAGMan_Applications.html#SECTION003108300000000000000

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              rynge Mats Rynge
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: