Page MenuHomeElementl

[demo pipelines] remove dynamic download pipeline
ClosedPublic

Authored by sandyryza on Aug 9 2021, 10:47 PM.

Details

Summary

The goal of the demo repo is to simulate what a "real" set of data application would look like, and a real data application would not include two parallel implementations of the same functionality. I think there are many opportunities for confusion if someone is trying to copy/paste code or figure out what patterns they themselves should follow.

If we want to showcase dynamic orchestration, we could add an additional pipeline or set of steps that require it. Maybe some hyperparameter search for the story recommender or something.

Test Plan

bk

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

makes sense -- I only kept it around in case we ended up using it for something, but I suppose git history will do.

This revision is now accepted and ready to land.Aug 9 2021, 11:29 PM