Page MenuHomePhabricator

Fix errors with GCP pipeline

Authored by sashank on Jan 14 2020, 12:58 AM.



Some of the breaking changes, to the config system left the gcp pipeline in a broken state. This diff fixes the config errors. Specifically, the input defs of composite solids have to match the first solid's input defs, and the output defs of a composite solid have to match the last solid's output_defs.

Test Plan

Add test

Diff Detail

R1 dagster
Automatic diff as part of commit; lint not applicable.
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

sashank created this revision.Jan 14 2020, 12:58 AM

why wasn't this caught by tests?

sashank updated this revision to Diff 8695.Jan 14 2020, 8:49 PM

Add dagster-gcp to

sashank updated this revision to Diff 8696.Jan 14 2020, 8:57 PM

Add dagster-gcp install to tox.ini

schrockn accepted this revision.Jan 14 2020, 10:38 PM

Seems good. Not sure with _START is better than 'start'


why not just 'start'? I don't see why the constant helps

This revision is now accepted and ready to land.Jan 14 2020, 10:38 PM
sashank added inline comments.Jan 14 2020, 10:55 PM

Just copied the pattern from other places we do this. Removed it here.

sashank updated this revision to Diff 8714.Jan 14 2020, 10:55 PM

Remove _START constant

This revision was automatically updated to reflect the committed changes.