Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1298

symlinking when running with containers

    XMLWordPrintable

Details

    • Icon: New Feature New Feature
    • Resolution: Fixed
    • Icon: Major Major
    • master, 4.9.0
    • master, 4.8.3
    • Pegasus Planner
    • None

    Description

      on our hip chat support channel

      Hello -- I'm looking for guidance running a Docker application in Pegasus. We have a shared filesystem mounted on our worker nodes (e.g., /data) but it is not being mounted into the container.  Looking at the user guide, it appears that only the job directory is mounted into /scratch.  With Singularity, I can resolve by adding the path to my image at build time.  

      [10:24 AM] Craig Willis (willis8@illinois.edu): We're working on a pilot workflow based on the collaboration with Mats. Not particularly pressing, but we are hoping to move to this implementation soon for a large-scale reprocessing.
      [10:25 AM] Craig Willis (willis8@illinois.edu): It sounds like at the moment, we should assume that the data is copied to the working directory. We were just hoping to avoid that step, if possibe.
      [10:25 AM] Craig Willis (willis8@illinois.edu): Or use Singularity.

      Attachments

        Activity

          People

            vahi Karan Vahi
            rynge Mats Rynge
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: