Page MenuHomePhabricator

Add basic GCP pipeline
AbandonedPublic

Authored by natekupp on Jul 19 2019, 10:55 PM.

Details

Reviewers
schrockn
Summary

Prototyping removing date partitions from the GCP pipeline - see the files under the `gcp_data_platform/basic` folder, which follow the same progression as before:

  • airflow_example.py - the airflow version
  • simple_pipeline.py - rough 1:1 conversion
  • resources_pipeline.py - extract resources
  • final_pipeline.py - extract config
Test Plan

n/a

Diff Detail

Repository
R1 dagster
Branch
add_basic_gcp_pipeline
Lint
Lint OK
Unit
No Unit Test Coverage

Event Timeline

natekupp created this revision.Jul 19 2019, 10:55 PM
natekupp edited the summary of this revision. (Show Details)Jul 19 2019, 11:06 PM
natekupp added a reviewer: schrockn.
natekupp abandoned this revision.Jul 22 2019, 5:09 PM