Page MenuHomeElementl

[caprisun] asset in
AbandonedPublic

Authored by sandyryza on Jul 29 2021, 11:12 PM.

Details

Summary

This allows setting metadata on inputs to software-defined assets.

This was motivated by trying to migrate the hacker news story recommender to assets. Some of the asset functions only use a subset of the columns in the tables that they depend on. Listing those inside the asset metadata allows the IOManager to avoid fetching unused columns.

Depends on D8969.

Test Plan

bk

Diff Detail

Repository
R1 dagster
Branch
asset-in (branched from master)
Lint
Lint Passed
Unit
No Test Coverage

Event Timeline

sandyryza retitled this revision from asset in to [caprisun] asset in.Aug 2 2021, 8:00 PM
sandyryza edited the summary of this revision. (Show Details)
sandyryza added reviewers: prha, owen, cdecarolis.

Like the general shape of this + how it makes the interface feel more similar to @op

python_modules/dagster/dagster/core/asset_defs/decorators.py
37–38

nit: Asset -> AssetIn

This revision is now accepted and ready to land.Aug 2 2021, 10:50 PM