HomeElementl

Add DockerRunLauncher
5e35523d9bfbUnpublished

Unpublished Commit ยท Learn More

Not On Permanent Ref: This commit is not an ancestor of any permanent ref.

Description

Add DockerRunLauncher

Summary:
This adds a run launcher that we could include as part of a docker-compose based deployment using a container for dagit and a container for dagster-daemon. (Our previous non-k8s docker example relied on everything being in a single container, which doesn't work well with the addition of the daemon). It's pretty similar to the existing celery docker executor, just launching runs instead of executing steps.

That said if we want to add this, I should probably create a separate dagster-docker module instead with no celery dependencies?

Test Plan: BK

Reviewers: alangenfeld, nate, sashank, johann, schrockn

Subscribers: prha, schrockn

Differential Revision: https://dagster.phacility.com/D5348

Details

Provenance
dgibsonAuthored on Dec 1 2020, 2:54 PM
Parents
R1:d0231689339d: Unpin kubernetes in dagster-k8s
Branches
Unknown
Tags
Unknown

Event Timeline