Page MenuHomeElementl

feat(helm): set compute log manager default as noop
ClosedPublic

Authored by rexledesma on Jul 23 2021, 2:19 PM.
Tags
None
Referenced Files
Unknown Object (File)
Mon, Jun 5, 4:39 AM
Unknown Object (File)
Mon, Jun 5, 4:01 AM
Unknown Object (File)
Mon, Jun 5, 3:51 AM
Unknown Object (File)
Mon, Jun 5, 3:37 AM
Unknown Object (File)
Sat, May 27, 3:48 AM
Unknown Object (File)
Fri, May 12, 8:21 AM
Unknown Object (File)
May 1 2023, 8:25 AM
Unknown Object (File)
May 1 2023, 8:15 AM
Subscribers
None

Details

Summary

In a Helm deployment of Dagster, it does not make sense to default to the
local compute log manager as pipeline runs are executed in ephemeral jobs.
In a Kubernetes environment, users should default to using a cloud provider
to host their compute logs.

We should deprecate the local compute log manager as configuration in our Helm
chart. Now, we default to the noop compute log manager. To prevent this from being
a breaking change, if the user previous specified the local compute log manager,
it will now noop (since it wasn't doing anything in the first place).

Test Plan

pytest

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

ya this is the right call

helm/dagster/schema/schema/charts/dagster/subschema/compute_log_manager.py
11–12

nit: comment here about deprecated

helm/dagster/values.yaml
135

nit maybe call more detail here - that it actually just points to NoOp

This revision is now accepted and ready to land.Jul 23 2021, 4:22 PM