Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1768

replace GRAM workflow tests with bosco

XMLWordPrintable

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • master, 5.1.0, 5.0.1
    • Affects Version/s: master, 5.0.0
    • Component/s: Testing
    • None

      Condor support for GRAM is broken. In addition GRAM is no longer officially supported . As part of this we will move our bamboo tests to a bosco setup to test for remote submissions. as part of this we have setup a dockerized slurm cluster on corbusier

      here is a site catalog entry for site CCG to be used for tests.

      sites:
      -
      name: "CCG"
      arch: "x86_64"
      os.type: "linux"
      os.release: "rhel"
      os.version: "7"
      directories:
      -
      type: "sharedScratch"
      path: "/nfs/bamboo/scratch-90-days/CCG/scratch/

      {run_id}"
      fileServers:
      -
      operation: "all"
      url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}

      "
      -
      type: "localStorage"
      path: "/nfs/bamboo/scratch-90-days/CCG/outputs"
      fileServers:
      -
      operation: "all"
      url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/outputs/

      {run_id}

      "
      grids:
      -
      type: "batch"
      contact: "corbusier.isi.edu"
      scheduler: "slurm"
      jobtype: "compute"
      -
      type: "batch"
      contact: "corbusier.isi.edu"
      scheduler: "slurm"
      jobtype: "compute"
      profiles:
      env:
      PEGASUS_HOME: "

      {cluster_pegasus_home}

      "
      pegasus:

      1. SSH is the style to use for Bosco SSH submits.
        style: ssh
      2. Works around bug in the HTCondor GAHP, that does not
      3. set the remote directory
        change.dir: 'true'
      4. the key to use for scp transfers
        SSH_PRIVATE_KEY: /scitech/home/bamboo/.ssh/workflow_id_rsa

            Assignee:
            vahi Karan Vahi
            Reporter:
            vahi Karan Vahi
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: