Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1185

destination in remote file transfers for inter site jobs point's to directory

    Details

      Description

      Reported by Michael Wang from LSST

      For intersite transfer jobs scheduled to run remotely on a site, then destination URL's seem to be missing the file


      cat 00/00/stage_inter_remote_catFilesInList_ID0000016_0.in

      [
      { "type": "transfer",
        "lfn": "dessv_kk12.out",
        "id": 1,
        "src_urls": [
          { "site_label": "FNAL_GPGrid", "url":
      "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/dessv_kk12.out"
      }
        ],
        "dest_urls": [
          { "site_label": "condorpool", "url":
      "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/." }
        ] }
      ,

      The local transfers are generated correctly
       more run0008/00/00/stage_inter_local_treecorr_ID0000008_0.in
      [
       { "type": "transfer",
         "lfn": "dessv_gg_z3.fits",
         "id": 1,
         "src_urls": [
           { "site_label": "condorpool", "url": "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/dessv_gg_z3.fits" }
         ],
         "dest_urls": [
           { "site_label": "FNAL_GPGrid", "url": "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/./dessv_gg_z3.fits" }
         ] }
      ]
      pierre:mwang vahi$

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              vahi Karan Vahi
            • Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: