Page MenuHomeElementl

[demo pipelines] remove dynamic download pipeline

Authored by sandyryza on Aug 9 2021, 10:47 PM.
Referenced Files
Unknown Object (File)
Fri, Aug 12, 4:47 PM
Unknown Object (File)
Fri, Aug 12, 4:46 PM
Unknown Object (File)
Thu, Aug 11, 11:26 AM
Unknown Object (File)
Mon, Aug 8, 9:14 AM
Unknown Object (File)
Sat, Aug 6, 12:04 PM
Unknown Object (File)
Fri, Aug 5, 10:46 PM
Unknown Object (File)
Thu, Aug 4, 3:47 AM
Unknown Object (File)
Wed, Aug 3, 1:55 PM



The goal of the demo repo is to simulate what a "real" set of data application would look like, and a real data application would not include two parallel implementations of the same functionality. I think there are many opportunities for confusion if someone is trying to copy/paste code or figure out what patterns they themselves should follow.

If we want to showcase dynamic orchestration, we could add an additional pipeline or set of steps that require it. Maybe some hyperparameter search for the story recommender or something.

Test Plan


Diff Detail

R1 dagster
Lint Not Applicable
Tests Not Applicable

Event Timeline

makes sense -- I only kept it around in case we ended up using it for something, but I suppose git history will do.

This revision is now accepted and ready to land.Aug 9 2021, 11:29 PM