Details
Description
Condor support for GRAM is broken. In addition GRAM is no longer officially supported . As part of this we will move our bamboo tests to a bosco setup to test for remote submissions. as part of this we have setup a dockerized slurm cluster on corbusier
here is a site catalog entry for site CCG to be used for tests.
sites:
-
name: "CCG"
arch: "x86_64"
os.type: "linux"
os.release: "rhel"
os.version: "7"
directories:
-
type: "sharedScratch"
path: "/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
fileServers:
-
operation: "all"
url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
-
type: "localStorage"
path: "/nfs/bamboo/scratch-90-days/CCG/outputs"
fileServers:
-
operation: "all"
url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/outputs/{run_id}"
grids:
-
type: "batch"
contact: "corbusier.isi.edu"
scheduler: "slurm"
jobtype: "compute"
-
type: "batch"
contact: "corbusier.isi.edu"
scheduler: "slurm"
jobtype: "compute"
profiles:
env:
PEGASUS_HOME: "{cluster_pegasus_home}"
pegasus:
# SSH is the style to use for Bosco SSH submits.
style: ssh
# Works around bug in the HTCondor GAHP, that does not
# set the remote directory
change.dir: 'true'
# the key to use for scp transfers
SSH_PRIVATE_KEY: /scitech/home/bamboo/.ssh/workflow_id_rsa
here is a site catalog entry for site CCG to be used for tests.
sites:
-
name: "CCG"
arch: "x86_64"
os.type: "linux"
os.release: "rhel"
os.version: "7"
directories:
-
type: "sharedScratch"
path: "/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
fileServers:
-
operation: "all"
url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
-
type: "localStorage"
path: "/nfs/bamboo/scratch-90-days/CCG/outputs"
fileServers:
-
operation: "all"
url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/outputs/{run_id}"
grids:
-
type: "batch"
contact: "corbusier.isi.edu"
scheduler: "slurm"
jobtype: "compute"
-
type: "batch"
contact: "corbusier.isi.edu"
scheduler: "slurm"
jobtype: "compute"
profiles:
env:
PEGASUS_HOME: "{cluster_pegasus_home}"
pegasus:
# SSH is the style to use for Bosco SSH submits.
style: ssh
# Works around bug in the HTCondor GAHP, that does not
# set the remote directory
change.dir: 'true'
# the key to use for scp transfers
SSH_PRIVATE_KEY: /scitech/home/bamboo/.ssh/workflow_id_rsa