-
Type: Bug
-
Resolution: Unresolved
-
Priority: Major
-
Affects Version/s: master, 4.8.0
-
Component/s: None
-
None
The mismatch between monitord notification / file stamping and tools like pegasus-statistics could be much improved. You should be able to for example run pegasus-statistics as part of an on_success notification on the dag.
The main thing preventing this from happening is that pegasus-stats (and maybe analyzer as well?) checks to see if the workflow has stopped before allowing them to run cleanly. This is done with files such as monitord.done.
I think this should be cleaned up, and the on_success, on_failure, and at_end notifications should all be run after the workflow has been marked as finished.