Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-68 Support for SeqExec as a Gridstart implementation
  3. PM-250

for worker node execution with seqexec wrapper clustered jobs stage the output products back to /tmp instead of head node directory

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 3.0
    • Fix Version/s: master, 3.0
    • Labels:
      None

      Description

      here is an example snippet

      sls input file for clustered job is correct
      BUBBLES:run0016 vahi$ more sls_merge_vahi-findrange_PID2_ID1.in
      srm://wind.isi.edu/submit/blackdiamond/data/david.f.a
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/david.f.a
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.b1
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b2
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.b2
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi-findrange
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi-findrange

      SLS output file for clustered job is wrong
      BUBBLES:run0016 vahi$ more sls_merge_vahi-findrange_PID2_ID1.out
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.c1
      gsiftp://wind.isi.edu//tmp/vahi.f.c1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.c2
      gsiftp://wind.isi.edu//tmp/vahi.f.c2

      SLS output file for non clustered job is correct

      BUBBLES:run0016 vahi$ more sls_preprocess_ID000001.out
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-preprocess_ID000001/vahi.f.b1
      gsiftp://wind.isi.edu//nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-preprocess_ID000001/vahi.f.b2
      gsiftp://wind.isi.edu//nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b2

        Attachments

          Activity

            People

            • Assignee:
              gideon Gideon Juve (Inactive)
              Reporter:
              vahi Karan Vahi
            • Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: