HomePhabricator

#1848 output_materialization_config should be able to yield arbitrarily many…

Authored by yuhan on Thu, Mar 19, 6:27 PM.

Description

#1848 output_materialization_config should be able to yield arbitrarily many Materializations

Summary:
Issue: https://github.com/dagster-io/dagster/issues/1848
Enabled @output_materialization_config to yield multiple Materializations

  • Addition to returning a Materialization, output_materialization_config can also yield multiple Materializations (a generator of Materializations.
    • To treat return and yield the same way in the core, we are going to check ensure_gen in OutputSchemaForDecorator.materialize_runtime_values every time this gets called.
  • Changed intro_tutorial/output_materialization.py to yield two Materializations (use case is to output both csv and json)

Test Plan:

  • unit
  • ran output_materialization in tutorial through CLI and dagit
  • BK

Reviewers: max, prha

Reviewed By: prha

Subscribers: alangenfeld

Differential Revision: https://dagster.phacility.com/D2263

Details

Committed
yuhanThu, Mar 19, 7:58 PM
Reviewer
prha
Differential Revision
D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations
Parents
R1:a1f7e63a2bf7: Support for pipeline tags
Branches
Unknown
Tags
Unknown