Page MenuHomePhabricator

[docs] Eliminate 'intermediates' in docs #3516
ClosedPublic

Authored by yuhan on Tue, Jan 12, 9:34 AM.

Details

Summary

https://github.com/dagster-io/dagster/issues/3516

update examples and visible docs changes:

replace intermediate with io manager:

rm:

will be in followup diffs:
example code change only

  • docs_snippets/legacy/data_science
  • docs_snippets/intro_tutorial/hello_cereal_pipeline.py (airflow related?)
  • airline_demo

overview/types: @sandyryza can you update https://docs.dagster.io/overview/types#dagster-type-use-cases when you finish the input output and type related stuff

Test Plan

yarn dev + example tests

Diff Detail

Repository
R1 dagster
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

yuhan requested review of this revision.Tue, Jan 12, 9:54 AM
yuhan edited the test plan for this revision. (Show Details)

A couple small comments - otherwise looks great!

docs/next/src/pages/examples/emr_pyspark.mdx
20–21

I think this is actually inaccurate (my bad, I wrote this before I understood what these things were). This can be changed to just "The EMR PySpark step launcher relies on S3 to shuttle config and events to and from EMR."

docs/next/src/pages/overview/execution/index.mdx
58

Maybe link to IO managers doc overview here?

This revision is now accepted and ready to land.Tue, Jan 12, 10:17 PM
yuhan marked 2 inline comments as done.

comments