Page MenuHomeElementl

Configure task_definition and container_name

Authored by jordansanders on Jun 30 2021, 8:48 PM.
Referenced Files
Unknown Object (File)
Tue, Mar 21, 12:54 PM
Unknown Object (File)
Mon, Mar 20, 8:09 PM
Unknown Object (File)
Sat, Mar 18, 7:11 AM
Unknown Object (File)
Thu, Mar 16, 10:10 AM
Unknown Object (File)
Sun, Mar 12, 5:34 PM
Unknown Object (File)
Fri, Mar 10, 10:56 PM
Unknown Object (File)
Tue, Mar 7, 11:10 PM
Unknown Object (File)
Tue, Mar 7, 12:44 AM



Previously, the EcsRunLauncher always created a new task definition.

Now, you can provide a task definition (family or ARN). If configured,
the EcsRunLauncher won't create its own task definition. This is a
coarse grained way of controlling how your runs execute. For example, if
you don't want to inheret the same memory specifications of the
parent process when running your pipeline, then you can define a new
task definition with different memory.

The EcsRunLauncher does minimal checks to ensure a task can actually be
placed using the custom task definition. It checks only that the task
definition actually exists and that there's a container that can be
overridden to execute teh dagster api execute_run command. By default,
it expects a container named "run" to be defined, but you can optionally
configure your own container name as well.

Depends on D8641

Test Plan


Diff Detail

R1 dagster
Lint Passed
No Test Coverage