Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1768

replace GRAM workflow tests with bosco

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • master, 5.0.0
    • master, 5.1.0, 5.0.1
    • Testing
    • None

    Description

      Condor support for GRAM is broken. In addition GRAM is no longer officially supported . As part of this we will move our bamboo tests to a bosco setup to test for remote submissions. as part of this we have setup a dockerized slurm cluster on corbusier

      here is a site catalog entry for site CCG to be used for tests.

      sites:
       -
        name: "CCG"
        arch: "x86_64"
        os.type: "linux"
        os.release: "rhel"
        os.version: "7"
        directories:
         -
          type: "sharedScratch"
          path: "/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
          fileServers:
           -
            operation: "all"
            url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/scratch/{run_id}"
         -
          type: "localStorage"
          path: "/nfs/bamboo/scratch-90-days/CCG/outputs"
          fileServers:
           -
            operation: "all"
            url: "scp://bamboo@corbusier.isi.edu:2222/nfs/bamboo/scratch-90-days/CCG/outputs/{run_id}"
        grids:
         -
          type: "batch"
          contact: "corbusier.isi.edu"
          scheduler: "slurm"
          jobtype: "compute"
         -
          type: "batch"
          contact: "corbusier.isi.edu"
          scheduler: "slurm"
          jobtype: "compute"
        profiles:
          env:
            PEGASUS_HOME: "{cluster_pegasus_home}"
          pegasus:
            # SSH is the style to use for Bosco SSH submits.
            style: ssh
            # Works around bug in the HTCondor GAHP, that does not
            # set the remote directory
            change.dir: 'true'
            # the key to use for scp transfers
            SSH_PRIVATE_KEY: /scitech/home/bamboo/.ssh/workflow_id_rsa

      Attachments

        Activity

          People

            vahi Karan Vahi
            vahi Karan Vahi
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: