Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1329

pegasus integrity causes LIGO workflows to fail

    XMLWordPrintable

    Details

      Description

      I can't get a LIGO workflow through with integrity checking turned on as it fails on the trigger merge jobs:

      2018-11-14 06:03:51,485 INFO: --------------------------------------------------------------------------------
      2018-11-14 06:03:51,485 INFO: Stats: Total 6751 transfers, 18.8 GB transferred in 71 seconds. Rate: 272.1 MB/s (2.1 Gb/s)
      2018-11-14 06:03:51,485 INFO: Between sites local->local : 6751 transfers, 18.8 GB transferred in 71 seconds. Rate: 272.1 MB/s (2.1 Gb/s)
      2018-11-14 06:03:51,485 INFO: All transfers completed successfully.
      ##################### Checking file integrity for input files #####################
      condor_exec.exe: line 74295: /var/lib/condor/execute/dir_46963/pegasus.uQi28sCTM/pegasus-4.9.1dev/bin/pegasus-integrity: Argument list too long
      2018-11-14 06:03:51: Last command exited with 1
      2018-11-14 06:03:51: /var/lib/condor/execute/dir_46963/pegasus.uQi28sCTM cleaned up
      PegasusLite: exitcode 1

      The files should be passes via stdin, like stagein jobs, and not on the command line.

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              dbrown Duncan Brown
            • Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: