HomeElementl

[demo pipelines] remove dynamic download pipeline

Description

[demo pipelines] remove dynamic download pipeline

Summary:
The goal of the demo repo is to simulate what a "real" set of data application would look like, and a real data application would not include two parallel implementations of the same functionality. I think there are many opportunities for confusion if someone is trying to copy/paste code or figure out what patterns they themselves should follow.

If we want to showcase dynamic orchestration, we could add an additional pipeline or set of steps that require it. Maybe some hyperparameter search for the story recommender or something.

Test Plan: bk

Reviewers: owen

Reviewed By: owen

Differential Revision: https://dagster.phacility.com/D9215

Details

Provenance
sandyryzaAuthored on Aug 9 2021, 10:40 PM
Reviewer
owen
Differential Revision
D9215: [demo pipelines] remove dynamic download pipeline
Parents
R1:1f60d6a581e8: [memoization 8/n] make default fs io manager memoizable
Branches
Unknown
Tags
Unknown