Details

Reviewers

cdecarolis
yuhan
sandyryza

Commits

R1:4b287b299cae: Add dbt pipeline to example repo, synchronize with internal

Summary

After this commit lands, this will be the source of truth for the current state of the hacker_news demo. A separate commit will strip down the internal repo to an import of this, along with some band-aid patches where necessary (e.g. links to specific demo sites)

Test Plan

Diff Detail

Repository

R1 dagster

Branch

owen_update_example_repo

Lint

Lint Passed

Unit

No Test Coverage

Event Timeline

owen created this revision.Jul 22 2021, 5:54 PM

remove dbt stuff for later diff

make black

Harbormaster failed remote builds in B34078: Diff 42104!Jul 22 2021, 6:25 PM

Harbormaster failed remote builds in B34074: Diff 42100!Jul 22 2021, 6:40 PM

Harbormaster failed remote builds in B34079: Diff 42105!Jul 22 2021, 6:46 PM

added dbt pipeline

re-add the dbt stuff

Harbormaster completed remote builds in B34154: Diff 42219.Jul 23 2021, 6:36 PM

owen published this revision for review.Jul 23 2021, 6:51 PM

Harbormaster failed remote builds in B34153: Diff 42217!Jul 23 2021, 7:52 PM

this is great!

would it make sense to move the hackernews integration tests to oss too? - is it possible that a change made in the main repo passes the unit tests here but fails the integration test? if so, it could get annoying to dance between two repos.

This revision is now accepted and ready to land.Jul 23 2021, 11:24 PM

Closed by commit R1:4b287b299cae: Add dbt pipeline to example repo, synchronize with internal (authored by owen). · Explain WhyJul 26 2021, 4:20 PM

This revision was automatically updated to reflect the committed changes.

owen added a commit: R1:4b287b299cae: Add dbt pipeline to example repo, synchronize with internal.

Add dbt pipeline to example repo, synchronize with internal
ClosedPublic
Actions

Details

Diff Detail

Event Timeline

Revision Contents
Changeset List

Diff 42219

examples/hacker_news/hacker_news/pipelines/dbt_pipeline.py

examples/hacker_news/hacker_news/pipelines/download_pipeline.py

examples/hacker_news/hacker_news/resources/dbt_asset_resource.py

examples/hacker_news/hacker_news/resources/fixed_s3_pickle_io_manager.py

examples/hacker_news/hacker_news/resources/hn_resource.py

examples/hacker_news/hacker_news/resources/parquet_io_manager.py

examples/hacker_news/hacker_news/resources/snowflake_io_manager.py

examples/hacker_news/hacker_news/sensors/download_pipeline_finished_sensor.py

examples/hacker_news/hacker_news/sensors/slack_on_pipeline_failure_sensor.py

examples/hacker_news/hacker_news/solids/dbt.py

examples/hacker_news/hacker_news/solids/download_items.py

examples/hacker_news/hacker_news/solids/id_range_for_time.py

examples/hacker_news/hacker_news_tests/test_pipelines/test_download_pipeline.py

examples/hacker_news/hacker_news_tests/test_resources/init.py

examples/hacker_news/hacker_news_tests/test_resources/test_snowflake_io_manager.py

examples/hacker_news/hacker_news_tests/test_sensors/test_download_pipeline_finished_sensor.py

examples/hacker_news/hacker_news_tests/test_sensors/test_slack_on_pipeline_failure_sensor.py

examples/hacker_news/hacker_news_tests/test_solids/test_download_items.py

Add dbt pipeline to example repo, synchronize with internalClosedPublicActions

Details

Diff Detail

Event Timeline

Revision ContentsChangeset List

Diff 42219

examples/hacker_news/hacker_news/pipelines/dbt_pipeline.py

examples/hacker_news/hacker_news/pipelines/download_pipeline.py

examples/hacker_news/hacker_news/resources/dbt_asset_resource.py

examples/hacker_news/hacker_news/resources/fixed_s3_pickle_io_manager.py

examples/hacker_news/hacker_news/resources/hn_resource.py

examples/hacker_news/hacker_news/resources/parquet_io_manager.py

examples/hacker_news/hacker_news/resources/snowflake_io_manager.py

examples/hacker_news/hacker_news/sensors/download_pipeline_finished_sensor.py

examples/hacker_news/hacker_news/sensors/slack_on_pipeline_failure_sensor.py

examples/hacker_news/hacker_news/solids/dbt.py

examples/hacker_news/hacker_news/solids/download_items.py

examples/hacker_news/hacker_news/solids/id_range_for_time.py

examples/hacker_news/hacker_news_tests/test_pipelines/test_download_pipeline.py

examples/hacker_news/hacker_news_tests/test_resources/__init__.py

examples/hacker_news/hacker_news_tests/test_resources/test_snowflake_io_manager.py

examples/hacker_news/hacker_news_tests/test_sensors/test_download_pipeline_finished_sensor.py

examples/hacker_news/hacker_news_tests/test_sensors/test_slack_on_pipeline_failure_sensor.py

examples/hacker_news/hacker_news_tests/test_solids/test_download_items.py

Add dbt pipeline to example repo, synchronize with internal
ClosedPublic
Actions

Revision Contents
Changeset List

examples/hacker_news/hacker_news_tests/test_resources/init.py