Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1298

symlinking when running with containers

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master, 4.8.3
    • Fix Version/s: master, 4.9.0
    • Component/s: pegasus-plan
    • Labels:
      None

      Description

      on our hip chat support channel

      Hello -- I'm looking for guidance running a Docker application in Pegasus. We have a shared filesystem mounted on our worker nodes (e.g., /data) but it is not being mounted into the container.  Looking at the user guide, it appears that only the job directory is mounted into /scratch.  With Singularity, I can resolve by adding the path to my image at build time.  

      [10:24 AM] Craig Willis (willis8@illinois.edu): We're working on a pilot workflow based on the collaboration with Mats. Not particularly pressing, but we are hoping to move to this implementation soon for a large-scale reprocessing.
      [10:25 AM] Craig Willis (willis8@illinois.edu): It sounds like at the moment, we should assume that the data is copied to the working directory. We were just hoping to avoid that step, if possibe.
      [10:25 AM] Craig Willis (willis8@illinois.edu): Or use Singularity.

        Attachments

          Activity

            People

            • Assignee:
              vahi Karan Vahi
              Reporter:
              rynge Mats Rynge
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: