HomePhabricator

First go at postgres event watcher

Authored by schrockn on Mon, Sep 9, 4:29 PM.

Description

First go at postgres event watcher

Summary:
Here we go with listen/notify. So this is actually working now.

The way I got the listen-notify loop to work was taking
https://github.com/djrobstep/pgnotify/blob/43bbe7bd3cedfb99700e4ab370cb6f5d7426bea3/pgnotify/notify.py
and then changing it to be python 2-compatible (by removing f strings)

The event watcher kicks off a process which polls the system to see if a
NOTIFY event has been detected and then dispatches the event record
across the a multiprocessing queue.

The event watcher maintains a set of runs that it should actually
dispatch events for.

Test Plan: buildkite

Reviewers: #ft, alangenfeld, prha, max

Reviewed By: #ft, alangenfeld

Differential Revision: https://dagster.phacility.com/D987

Details

Committed
schrocknWed, Sep 11, 9:44 PM
Reviewer
Restricted Project
Differential Revision
D987: First go at postgres event watcher
Parents
R1:903a3ab8f8cd: RFC: Add mutation for executing pipeline with preset
Branches
Unknown
Tags
Unknown