HomeElementl

Test ECS reference deployment

Description

Test ECS reference deployment

Summary:
Use the docker-compose ECS local simulator to test our ECS deployment.
This substitutes the DefaultRunLauncher for the EcsRunLauncher because
the latter cannot run locally and it builds the images from source.

Eventually, we can extend this to run on real ECS as well.

Additionally, this adds a pattern for doing our usual networking
shenanigans but from within PyTest fixtures. I found the approach to
be more flexible and if it's something we like, we can generalize it
and use it across all of our Buildkite docker-compose-in-docker use
cases.

Test Plan: unit, integration

Reviewers: dgibson, alangenfeld, max

Reviewed By: dgibson

Differential Revision: https://dagster.phacility.com/D8575

Details

Provenance
jordansandersAuthored on Jun 24 2021, 9:04 PM
Reviewer
dgibson
Differential Revision
D8575: Test ECS reference deployment
Parents
R1:cfc780b1c3af: Docs: Re-execution guide (#4220)
Branches
Unknown
Tags
Unknown