Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1198

monitord improvements to support nicer notifications

XMLWordPrintable

    • Type: Icon: Bug Bug
    • Resolution: Unresolved
    • Priority: Icon: Major Major
    • 5.1.0
    • Affects Version/s: master, 4.8.0
    • Component/s: None
    • None

      The mismatch between monitord notification / file stamping and tools like pegasus-statistics could be much improved. You should be able to for example run pegasus-statistics as part of an on_success notification on the dag.

      The main thing preventing this from happening is that pegasus-stats (and maybe analyzer as well?) checks to see if the workflow has stopped before allowing them to run cleanly. This is done with files such as monitord.done.

      I think this should be cleaned up, and the on_success, on_failure, and at_end notifications should all be run after the workflow has been marked as finished.

            Assignee:
            vahi Karan Vahi
            Reporter:
            rynge Mats Rynge
            Watchers:
            2 Start watching this issue

              Created:
              Updated: