HomePhabricator

Fix for Dagster errors not failing tasks in Airflow

Authored by nate on Dec 5 2019, 6:24 PM.

Description

Fix for Dagster errors not failing tasks in Airflow

Summary: This addresses the issue where Dagster step failures were not being surfaced as task failures in Airflow

Test Plan:
unit, and manually tested a failing pipeline in Airflow UI with:

dagster-airflow scaffold -m dagster_examples.toys.airflow_examples --pipeline-name demo_error_pipeline
docker run -d -p 8080:8080 \
 -v $AIRFLOW_HOME/dags:/usr/local/airflow/dags dagster-airflow-webserver webserver

Reviewers: alangenfeld, max

Reviewed By: alangenfeld

Differential Revision: https://dagster.phacility.com/D1543

Details

Committed
nateDec 5 2019, 6:52 PM
Reviewer
alangenfeld
Differential Revision
D1543: Fix for Dagster errors not failing tasks in Airflow
Parents
R1:398b955c0ef5: Print process on dagit load
Branches
Unknown
Tags
Unknown