Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1185

destination in remote file transfers for inter site jobs point's to directory

    XMLWordPrintable

Details

    Description

      Reported by Michael Wang from LSST

      For intersite transfer jobs scheduled to run remotely on a site, then destination URL's seem to be missing the file


      cat 00/00/stage_inter_remote_catFilesInList_ID0000016_0.in

      [
      { "type": "transfer",
        "lfn": "dessv_kk12.out",
        "id": 1,
        "src_urls": [
          { "site_label": "FNAL_GPGrid", "url":
      "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/dessv_kk12.out"
      }
        ],
        "dest_urls": [
          { "site_label": "condorpool", "url":
      "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/." }
        ] }
      ,

      The local transfers are generated correctly
       more run0008/00/00/stage_inter_local_treecorr_ID0000008_0.in
      [
       { "type": "transfer",
         "lfn": "dessv_gg_z3.fits",
         "id": 1,
         "src_urls": [
           { "site_label": "condorpool", "url": "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/dessv_gg_z3.fits" }
         ],
         "dest_urls": [
           { "site_label": "FNAL_GPGrid", "url": "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/./dessv_gg_z3.fits" }
         ] }
      ]
      pierre:mwang vahi$

      Attachments

        Activity

          People

            vahi Karan Vahi
            vahi Karan Vahi
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: