Details
-
Bug
-
Resolution: Fixed
-
Major
-
master, 4.7.4
-
None
Description
Reported by Michael Wang from LSST
For intersite transfer jobs scheduled to run remotely on a site, then destination URL's seem to be missing the file
cat 00/00/stage_inter_remote_catFilesInList_ID0000016_0.in
[
{ "type": "transfer",
"lfn": "dessv_kk12.out",
"id": 1,
"src_urls": [
{ "site_label": "FNAL_GPGrid", "url":
"gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/dessv_kk12.out"
}
],
"dest_urls": [
{ "site_label": "condorpool", "url":
"file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/." }
] }
,
The local transfers are generated correctly
more run0008/00/00/stage_inter_local_treecorr_ID0000008_0.in
[
{ "type": "transfer",
"lfn": "dessv_gg_z3.fits",
"id": 1,
"src_urls": [
{ "site_label": "condorpool", "url": "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/dessv_gg_z3.fits" }
],
"dest_urls": [
{ "site_label": "FNAL_GPGrid", "url": "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/./dessv_gg_z3.fits" }
] }
]
pierre:mwang vahi$
For intersite transfer jobs scheduled to run remotely on a site, then destination URL's seem to be missing the file
cat 00/00/stage_inter_remote_catFilesInList_ID0000016_0.in
[
{ "type": "transfer",
"lfn": "dessv_kk12.out",
"id": 1,
"src_urls": [
{ "site_label": "FNAL_GPGrid", "url":
"gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/dessv_kk12.out"
}
],
"dest_urls": [
{ "site_label": "condorpool", "url":
"file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/." }
] }
,
The local transfers are generated correctly
more run0008/00/00/stage_inter_local_treecorr_ID0000008_0.in
[
{ "type": "transfer",
"lfn": "dessv_gg_z3.fits",
"id": 1,
"src_urls": [
{ "site_label": "condorpool", "url": "file:///data/des61.b/data/mwang/scratch/mwang/pegasus/wlpipe/run0008/dessv_gg_z3.fits" }
],
"dest_urls": [
{ "site_label": "FNAL_GPGrid", "url": "gsiftp://fndca1.fnal.gov:2811/des/persistent/mwang/gridscratch/mwang/pegasus/wlpipe/run0008/./dessv_gg_z3.fits" }
] }
]
pierre:mwang vahi$