This demonstrates how to use docker-compose do deploy a Dagster stack to
ECS (and how to run the same stack locally for development). I chose the
docker-compose route over with several different alternatives
(CloudFormation template, AWS Copilot, Terraform, etc.):
- CloudFormation and Terraform force our hand toward taking on too much
devops responsibility (providing recommendation on how to setting up
VPCs, Load Balancers, etc.)
- Copilot's tooling wasn't mature enough
- Several users have recently expressed interest in trying to deploy our
deploy_docker docker-compose.yaml to ECS.
I'm primarily looking for feedback on ifs this the right level of detail
to provide. I want to strike a balance between not being too opinionated
about how users run their infrastructure while keeping it easy for
somebody to get the example up and running in ~15 minutes.
Once we're generally in agreement, I can move the docs into our actual
docs site and then begin work on an ECSRunLauncher (so we don't need to
launch runs inside our grpc container)