job id's in the DAX to be passed to kickstart invocation

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

    • Type: Sub-task
    • Resolution: Fixed
    • Priority: Major
    • master, 3.1
    • Affects Version/s: master, 3.1
    • Component/s: Pegasus Planner
    • None

      currently the derivation is passed as value of the -N option to kickstart.

      For 3.1, the derivation should be set to the logical id in the DAX for that job.

      For pegasus generated jobs null should be passed

      For clustered jobs, the .in files should have a comment for each invocation that includes both transformation, derivation and the associated task id. It should use the format below:

      1. task_id transformation derivation
      1. 1 montage::mProject ID0000001
      2. 2 montage::mProject ID0000002
        ...

      For non-clustered jobs, we need to include the dax id in the submit file as a classad, it should be of the form:

      +pegasus_wf_dax_job_id = "xxxx"

      where "xxxx" can be "null" for Pegasus generated jobs.

      The above comments can go anywhere in the file, can be interleaved with the invocation lines, or put together at the end.

            Assignee:
            Karan Vahi
            Reporter:
            Karan Vahi
            Archiver:
            Rajiv Mayani

              Created:
              Updated:
              Resolved:
              Archived: