Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-38

Condor File Transfers in local and scheduler universe

XMLWordPrintable

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Minor Minor
    • 2.4.1
    • Affects Version/s: 2.0
    • Component/s: Pegasus Planner
    • None
    • Environment:
      Operating System: Mac OS
      Platform: PC
    • 40

      Condor File Transfers ( using transfer_input_files ) dont work in local or scheduler universe.

      If the transfer_input_files is set for scheduler/local universe jobs, the stdout/stderr of the jobs is transferred to files named _condor_stdout _condor_stderr in the submit directory, rather
      the files specified in the submit files. This affects all condor versions.

      This triggers a failure in workflow only if one has set exitcode to fail on empty postscript.
      This is hard to debug as nowhere a fatal error occurs.

      I reported to Condor 2 years back about this. However, they have not fixed it. Hence Pegasus should try to take care of this. We encounter this condition when we are using the GUC transfer mode in Pegasus in a third party mode. Since, the new GUC takes in an input file as a command line option rather than from stdin, the condor file transfer is created for the .in file.

            Assignee:
            vahi Karan Vahi
            Reporter:
            vahi Karan Vahi
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: