Currently you can't use the queued run coordinator without setting a max runs limit.
Details
Details
- Reviewers
dgibson prha alangenfeld
Since this is the new default, both disabled and enabled case are covered by existing tests
Diff Detail
Diff Detail
- Repository
- R1 dagster
- Branch
- queuer-disable-max-runs (branched from master)
- Lint
Lint OK - Unit
No Unit Test Coverage
Event Timeline
Comment Actions
I think I'm missing some context here? I'm just thinking about the 'pit of success' here - it seems like the easiest behavior to get yourself into here if you don't bother to read the description and start the daemon up is a dequeue daemon that doesn't actually do any queueing, which seems unlikely to be what most people would want. Could we either make the CLI argument required (and > 0) or set it to a reasonable default?
Comment Actions
I'm not sure about making it required, since in places like Helm we'll probably end up providing some default again. Is there a reasonable default that you have in mind? Not opposed to just leaving it at 10.
Comment Actions
I think this kind of thing is also one reason I like the idea of putting config like this on the instance rather than in CLI params? as in https://dagster.phacility.com/D5009 - then you don't need to worry about what the limit is if you didn't set up this coordinator, and when you do set that coordinator you can also specify the limit that's specific to that daemon