for worker node execution with seqexec wrapper clustered jobs stage the output products back to /tmp instead of head node directory

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

      here is an example snippet

      sls input file for clustered job is correct
      BUBBLES:run0016 vahi$ more sls_merge_vahi-findrange_PID2_ID1.in
      srm://wind.isi.edu/submit/blackdiamond/data/david.f.a
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/david.f.a
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.b1
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b2
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.b2
      gsiftp://wind.isi.edu/nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi-findrange
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi-findrange

      SLS output file for clustered job is wrong
      BUBBLES:run0016 vahi$ more sls_merge_vahi-findrange_PID2_ID1.out
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.c1
      gsiftp://wind.isi.edu//tmp/vahi.f.c1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-merge_vahi-findrange_PID2_ID1/vahi.f.c2
      gsiftp://wind.isi.edu//tmp/vahi.f.c2

      SLS output file for non clustered job is correct

      BUBBLES:run0016 vahi$ more sls_preprocess_ID000001.out
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-preprocess_ID000001/vahi.f.b1
      gsiftp://wind.isi.edu//nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b1
      file:///osg/worker-node/tmp/vahi-pegasus-blackdiamond-run0016-preprocess_ID000001/vahi.f.b2
      gsiftp://wind.isi.edu//nfs/shared-scratch/vahi/workdir/vahi/pegasus/blackdiamond/run0016/vahi.f.b2

            Assignee:
            Gideon Juve
            Reporter:
            Karan Vahi
            Archiver:
            Rajiv Mayani

              Created:
              Updated:
              Resolved:
              Archived: