bk, pip install
should we call it dagster-emr?
dagster-aws has some non-PySpark EMR stuff in it (EmrJobRunner). The motivation for this change came from a user who wanted to be able to use that stuff without pulling in pyspark dependencies.
Closed by commit R1:0bfc6665cd76: create dagster-aws-pyspark library with emr_pyspark_step_launcher (authored by sandyryza). · Explain WhyOct 26 2020, 3:14 PM2020-10-26 15:14:30 (UTC+0)
This revision was automatically updated to reflect the committed changes.