Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1796

passing properties to be set for sub workflow jobs

    XMLWordPrintable

Details

    Description

      Currently, a user does not have a way to specify properties for sub workflow jobs. Hence users use the add_args function after adding the planner_args

      j1 = SubWorkflow("subwf1.yml", _id="subwf1")\
              .add_planner_args(verbose=3)\
              .add_inputs(input_file, output_map_sw1)\
              .add_outputs(k1_out)


      # I need to add the sub-workflow output map to the planning job.
      j1.add_args('-Dpegasus.dir.storage.mapper.replica.file=output_sw1.map')

      The problem is that order is important, since in java any property has to appear first on the command line. So when the yaml for the job is created, we have to ensure all properties are specified first via the -D notation before specifying any command line arguments

      Attachments

        Activity

          People

            tanaka Ryan Tanaka
            vahi Karan Vahi
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: