Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1773

improve checkpointing to handle asynchronous saving of checkpoint files back to staging site

XMLWordPrintable

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major Major
    • master, 5.1.0
    • Affects Version/s: master, 5.1.0
    • Component/s: None
    • None

      Improve checkpointing s.t. checkpoint files can be sent back to the staging site asynchronously while a job is running.

      Notes: https://docs.google.com/document/d/1Z44IKt8aiFRNhfX7RguS_zx5VM9KQ0Fz/edit

        1.
        		 implement background checkpointing process Sub-task Open Karan Vahi
        2.
        		 add changes to the Python API to support adding of checkpoint files by pattern Sub-task Open Karan Vahi
        3.
        		 refactor pegasus-transfer so that it can be invoked directly from pegasus-checkpoint Sub-task Resolved Ryan Tanaka (Inactive)

            Assignee:
            vahi Karan Vahi
            Reporter:
            tanaka Ryan Tanaka (Inactive)
            Watchers:
            1 Start watching this issue

              Created:
              Updated: