HomeElementl

Revamp the configuration concept section
2e27ffc482ddUnpublished

Unpublished Commit ยท Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.

Description

Revamp the configuration concept section

Summary:

  • Explained the basic idea of config (you pass it to pipelines at runtime).
  • Explained what situations users should use config in.
  • Took out the config-mapping example, because I think it violates our guidance on when to use config (the Spark parameters that are the same across all runs shouldn't be config at all).
  • Added in an example of how to make a config value available to multiple solids.

Potential TODO - lead with an example that does not use config schema (just Any or something).

Test Plan: manual inspection

Reviewers: schrockn, yuhan, alangenfeld

Differential Revision: https://dagster.phacility.com/D7438

Details

Provenance
sandyryzaAuthored on Apr 14 2021, 9:31 PM
Parents
R1:5a6fb8293c0a: fix non-required fields in IOManager output_config_schemas
Branches
Unknown
Tags
Unknown

Event Timeline