Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1350

pegasus is ignoring when_to_transfer_output

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 4.9.0
    • Fix Version/s: master, 5.0.0, 4.9.1
    • Component/s: pegasus-plan
    • Labels:
      None

      Description

      In the site catalog we have set <profile namespace="condor" key="when_to_transfer_output">ON_EXIT_OR_EVICT</profile> and pegasus is seeing this when it plans the job:

      subdax_test_condorio-main_ID0000001.pre.log.000: <profile namespace="condor" key="when_to_transfer_output" >ON_EXIT_OR_EVICT</profile>

      However, all the jobs are planned with ON_EXIT not ON_EXIT_OR_EVICT

      [dbrown@sugwg-condor test_condorio-main_ID0000001]$ grep when_to *sub
      inference-H1L1V1_ID1_ID0000002.sub:when_to_transfer_output = ON_EXIT

      This happens for both nonsharedfs and condorio.

      A test example is in /usr1/dbrown/daniel on sugwg-scitokens.phy.syr.edu and can be planned with

      pegasus-plan -Dpegasus.workflow.root.uuid=cdf2d39d-a15b-4399-8160-8f02301bd271 -Dpegasus.catalog.transformation.file=test_condorio-main.tc.txt -Dpegasus.dir.storage.mapper.replica=File -Dpegasus.dir.storage.mapper.replica.file=test_condorio-main.map --conf pegasus.7568274411182440052.properties --dir `pwd` --relative-dir ./test_condorio-main_ID0000001 --relative-submit-dir ./test_condorio-main_ID0000001 --sites local --cache /home/daniel.finstad/projects/bh_spin_priors/gw150914/test_condorio/_reuse.cache,test_condorio-0.cache --inherited-rc-files test_condorio-0.replica.store --cluster label,horizontal --output-site local --cleanup none --verbose --verbose --verbose --deferred --group pegasus --dax test_condorio-main.dax

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              dbrown Duncan Brown
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: