Page MenuHomeElementl

Add Scheduler to dagit and DagsterGraphQLContext
ClosedPublic

Authored by sashank on Aug 12 2019, 6:45 PM.

Details

Reviewers
alangenfeld
Group Reviewers
Restricted Project
Commits
R1:a8adcc7d7e40: Add Scheduler to dagit and DagsterGraphQLContext
Summary

Add Scheduler to the DagsterGraphQLContext and the option to specify the storage directory for schedules in the dagit cli. By default, the storage directory is $DAGSTER_HOME/schedules

Test Plan

run dagit with SCHEDULER feature enabled, unit

dagster.cgf:

[FEATURES]
scheduler=

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

alangenfeld added a subscriber: alangenfeld.
alangenfeld added inline comments.
python_modules/dagster/dagster/utils/__init__.py
272–310

lets set up something a little better here - we should at bare minimum use an enum. Could be nice to set up something cute
being able to do Features.SCHEDULER.is_enabled() for example just to spitball an api

This revision now requires changes to proceed.Aug 12 2019, 9:23 PM

Update to use new Scheduler

Create Features class:

  • Check if feature is enabled using Features.FEATURENAME.is_enabled
sashank retitled this revision from Add schedule storage to dagit to Add Scheduler to dagit and DagsterGraphQLContext.Aug 13 2019, 5:10 AM
sashank edited the summary of this revision. (Show Details)
alangenfeld added inline comments.
python_modules/dagit/dagit/cli.py
73

hm wonder if this will be useful at all

python_modules/dagster/dagster/utils/__init__.py
272–310

_ prefix these since they shouldnt be used outside this file

This revision is now accepted and ready to land.Aug 13 2019, 3:13 PM

Make get_enabled_features() private

Use six.raise_from in SystemCronScheduler (from last diff)