In the site catalog we have set <profile namespace="condor" key="when_to_transfer_output">ON_EXIT_OR_EVICT</profile> and pegasus is seeing this when it plans the job:

subdax_test_condorio-main_ID0000001.pre.log.000: <profile namespace="condor" key="when_to_transfer_output" >ON_EXIT_OR_EVICT</profile>

However, all the jobs are planned with ON_EXIT not ON_EXIT_OR_EVICT

[dbrown@sugwg-condor test_condorio-main_ID0000001]$ grep when_to *sub
inference-H1L1V1_ID1_ID0000002.sub:when_to_transfer_output = ON_EXIT

This happens for both nonsharedfs and condorio.

A test example is in /usr1/dbrown/daniel on sugwg-scitokens.phy.syr.edu and can be planned with

pegasus-plan -Dpegasus.workflow.root.uuid=cdf2d39d-a15b-4399-8160-8f02301bd271 -Dpegasus.catalog.transformation.file=test_condorio-main.tc.txt -Dpegasus.dir.storage.mapper.replica=File -Dpegasus.dir.storage.mapper.replica.file=test_condorio-main.map --conf pegasus.7568274411182440052.properties --dir `pwd` --relative-dir ./test_condorio-main_ID0000001 --relative-submit-dir ./test_condorio-main_ID0000001 --sites local --cache /home/daniel.finstad/projects/bh_spin_priors/gw150914/test_condorio/_reuse.cache,test_condorio-0.cache --inherited-rc-files test_condorio-0.replica.store --cluster label,horizontal --output-site local --cleanup none --verbose --verbose --verbose --deferred --group pegasus --dax test_condorio-main.dax