pegasus integrity causes LIGO workflows to fail

XMLWordPrintable

      I can't get a LIGO workflow through with integrity checking turned on as it fails on the trigger merge jobs:

      2018-11-14 06:03:51,485 INFO: --------------------------------------------------------------------------------
      2018-11-14 06:03:51,485 INFO: Stats: Total 6751 transfers, 18.8 GB transferred in 71 seconds. Rate: 272.1 MB/s (2.1 Gb/s)
      2018-11-14 06:03:51,485 INFO: Between sites local->local : 6751 transfers, 18.8 GB transferred in 71 seconds. Rate: 272.1 MB/s (2.1 Gb/s)
      2018-11-14 06:03:51,485 INFO: All transfers completed successfully.

                                              1. Checking file integrity for input files #####################
                                                condor_exec.exe: line 74295: /var/lib/condor/execute/dir_46963/pegasus.uQi28sCTM/pegasus-4.9.1dev/bin/pegasus-integrity: Argument list too long
                                                2018-11-14 06:03:51: Last command exited with 1
                                                2018-11-14 06:03:51: /var/lib/condor/execute/dir_46963/pegasus.uQi28sCTM cleaned up
                                                PegasusLite: exitcode 1

      The files should be passes via stdin, like stagein jobs, and not on the command line.

            Assignee:
            Karan Vahi
            Reporter:
            Duncan Brown
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: