Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-833

Pegasus should manage directory structure on the staging site

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: master
    • Fix Version/s: master, 4.7.0
    • Component/s: Pegasus Planner
    • Labels:
      None

      Description

      Pegasus should manage the directory structure on the scratch file system. For the new ahope workflows, there are about 800K files placed in a single directory which adversely affects the performance on the filesystem

      LIGO would like Pegasus to manage this space.

      On the output site, the output mappers solve the organization problem.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vahi Karan Vahi
                Reporter:
                dbrown Duncan Brown
              • Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: