Paths

Table of Contentst

Diffusion dagster 9f220f20f3e4

address-store-0 AssetAddress + AssetStore
9f220f20f3e4
Actions

Description

address-store-0 AssetAddress + AssetStore

Summary:

AssetStore: user-defined write/read
- AssetStoreHandle: a handle (it has info like asset_store_key and metadata) pointing to an asset_store threaded through step_context.resources
ASSET_STORE_OPERATION event

Test Plan:
unit

ran the pickled_object.py three times:

Reviewers: sandyryza, cdecarolis, schrockn

Reviewed By: sandyryza, schrockn

Differential Revision: https://dagster.phacility.com/D4820

Details

Provenance

yuhan

Authored on Oct 19 2020, 9:50 PM

Reviewer

sandyryza

Differential Revision

D4820: address-store-0 AssetAddress + AssetStore

Parents

R1:32498787067f: add community contributions

Branches

Unknown

Tags

Unknown

Event Timeline

yuhan committed R1:9f220f20f3e4: address-store-0 AssetAddress + AssetStore (authored by yuhan).Oct 23 2020, 12:24 AM

yuhan added an edge: D4820: address-store-0 AssetAddress + AssetStore.

Changes (23)

Path

Size

examples/

	asset_store/
	legacy_examples/	dagster_examples/	gcp_data_platform/

README.md

	asset_store/
	airflow_ingest/

__init__.py

	asset_store/
	basic_pyspark/

requirements.txt

	asset_store/	tests/
		airflow_ingest/

__init__.py

	asset_store/
	dep_dsl/

tox.ini

python_modules/

dagster/

core/

definitions/

events.py

output.py

events/

__init__.py

execution/

context/

plan/

storage/

intermediate_storage.py

dagster_tests/

core_tests/

storage_tests/

test_asset_store.py

R1:9f220f20f3e4

View Options

examples/asset_store/.gitignore

View Options

examples/asset_store/README.md

View Options

examples/asset_store/init.py

View Options

examples/asset_store/pickled_object.py

View Options

examples/asset_store/requirements.txt

View Options

examples/asset_store/tests/init.py

View Options

examples/asset_store/tests/test_asset_store.py

View Options

examples/asset_store/tox.ini

View Options

examples/asset_store/workspace.yaml

View Options

python_modules/dagster/dagster/core/definitions/events.py

View Options

python_modules/dagster/dagster/core/definitions/output.py

View Options

python_modules/dagster/dagster/core/events/init.py

View Options

python_modules/dagster/dagster/core/execution/context/system.py

View Options

python_modules/dagster/dagster/core/execution/plan/compute.py

View Options

python_modules/dagster/dagster/core/execution/plan/execute_step.py

View Options

python_modules/dagster/dagster/core/execution/plan/objects.py

View Options

python_modules/dagster/dagster/core/execution/plan/plan.py

View Options

python_modules/dagster/dagster/core/execution/resources_init.py

View Options

python_modules/dagster/dagster/core/storage/asset_store.py

View Options

python_modules/dagster/dagster/core/storage/intermediate_storage.py

View Options

python_modules/dagster/dagster_tests/core_tests/storage_tests/test_asset_store.py

address-store-0 AssetAddress + AssetStore9f220f20f3e4Actions

Description

Details

Event Timeline

Changes (23)

R1:9f220f20f3e4

examples/asset_store/.gitignore

examples/asset_store/README.md

examples/asset_store/__init__.py

examples/asset_store/pickled_object.py

examples/asset_store/requirements.txt

examples/asset_store/tests/__init__.py

examples/asset_store/tests/test_asset_store.py

examples/asset_store/tox.ini

examples/asset_store/workspace.yaml

python_modules/dagster/dagster/core/definitions/events.py

python_modules/dagster/dagster/core/definitions/output.py

python_modules/dagster/dagster/core/events/__init__.py

python_modules/dagster/dagster/core/execution/context/system.py

python_modules/dagster/dagster/core/execution/plan/compute.py

python_modules/dagster/dagster/core/execution/plan/execute_step.py

python_modules/dagster/dagster/core/execution/plan/objects.py

python_modules/dagster/dagster/core/execution/plan/plan.py

python_modules/dagster/dagster/core/execution/resources_init.py

python_modules/dagster/dagster/core/storage/asset_store.py

python_modules/dagster/dagster/core/storage/intermediate_storage.py

python_modules/dagster/dagster_tests/core_tests/storage_tests/test_asset_store.py

address-store-0 AssetAddress + AssetStore
9f220f20f3e4
Actions

examples/asset_store/init.py

examples/asset_store/tests/init.py

python_modules/dagster/dagster/core/events/init.py