this diff prototypes an event-based pipeline hook. this is really similar to the solid hooks i wrote before.
- diffs related to solid hooks: D3977 and its related stack
imo the pieces are
- how to define a pipeline hook, e.g. alert on what
- how to specify a pipeline hook, e.g. triggered by which pipeline
- how to thread it so it works properly with all the dagster machinery, e.g. where it gets triggered, which layer we plug it into
this is really really hacky. it is working (see examples/hooks/pipeline_hooks.py) but i don't feel good about any of the piece here...
relevant discussion: https://github.com/dagster-io/dagster/issues/3613
i think it makes sense to thread the hook into the execution plan layer - it's on pipeline def now, which i dont think is good