Page MenuHomePhabricator
Feed All Stories

Tue, Aug 13

sashank updated the diff for D804: Create Scheduler GraphQL interface.

Remove timestamp from schedule filenames, removing the need for a wrapper around schedules in SystemCronScheduler

Tue, Aug 13, 11:19 PM
max updated the diff for D802: Update docs and changelog for 0.5.6.

Rebase

Tue, Aug 13, 11:17 PM
max committed R1:e51ac849fc83: Actually preserve the original config dict (authored by max).
Actually preserve the original config dict
Tue, Aug 13, 11:17 PM
Max Gasner <max.gasner@gmail.com> closed D808: Actually preserve the original config dict.
Tue, Aug 13, 11:17 PM
max abandoned D583: Add expectations pipeline with histograms.
Tue, Aug 13, 11:14 PM
max updated the diff for D808: Actually preserve the original config dict.

Nits

Tue, Aug 13, 11:10 PM
Harbormaster failed remote builds in B2940: Diff 3673 for D808: Actually preserve the original config dict!
Tue, Aug 13, 11:08 PM
max accepted D812: [log sink] multiprocess executor.
Tue, Aug 13, 11:08 PM
max accepted D811: [log sink] RunConfig log_sink.

can't wait for this to go

Tue, Aug 13, 11:06 PM
max added inline comments to D808: Actually preserve the original config dict.
Tue, Aug 13, 11:05 PM
max accepted D810: [log sink] move dagstermill xproc log to dagster.
Tue, Aug 13, 11:05 PM
max updated the diff for D808: Actually preserve the original config dict.

Nits

Tue, Aug 13, 11:02 PM
Harbormaster failed remote builds in B2938: Diff 3671 for D811: [log sink] RunConfig log_sink!
Tue, Aug 13, 11:02 PM
Harbormaster failed remote builds in B2936: Diff 3669 for D789: Naive watcher for filesystem log storage!
Tue, Aug 13, 10:58 PM
alangenfeld created D812: [log sink] multiprocess executor.
Tue, Aug 13, 10:53 PM
alangenfeld created D811: [log sink] RunConfig log_sink.
Tue, Aug 13, 10:52 PM
alangenfeld created D810: [log sink] move dagstermill xproc log to dagster.
Tue, Aug 13, 10:51 PM
max updated the diff for D789: Naive watcher for filesystem log storage.

Cp

Tue, Aug 13, 10:50 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Fix diff

Tue, Aug 13, 10:44 PM
Harbormaster failed remote builds in B2934: Diff 3667 for D804: Create Scheduler GraphQL interface!
Tue, Aug 13, 8:57 PM
sashank added inline comments to D804: Create Scheduler GraphQL interface.
Tue, Aug 13, 8:56 PM
Harbormaster failed remote builds in B2933: Diff 3666 for D804: Create Scheduler GraphQL interface!
Tue, Aug 13, 8:54 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

make graphql

Tue, Aug 13, 8:51 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Change type of execution_params to String

Tue, Aug 13, 8:48 PM
Nate Kupp <nate@elementl.com> closed D801: Initial k8s operator and split out of shared functionality.
Tue, Aug 13, 8:43 PM
natekupp committed R1:0c6d7f755c79: Initial k8s operator and split out of shared functionality (authored by James Meickle <eronarn@gmail.com>).
Initial k8s operator and split out of shared functionality
Tue, Aug 13, 8:43 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

ugh coveralls. rebase master

Tue, Aug 13, 8:35 PM
sashank committed R1:a8adcc7d7e40: Add Scheduler to dagit and DagsterGraphQLContext (authored by sashank).
Add Scheduler to dagit and DagsterGraphQLContext
Tue, Aug 13, 8:34 PM
Sashank Thupukari <s@thupukari.com> closed D798: Add Scheduler to dagit and DagsterGraphQLContext.
Tue, Aug 13, 8:34 PM
Harbormaster failed remote builds in B2931: Diff 3662 for D801: Initial k8s operator and split out of shared functionality!
Tue, Aug 13, 8:33 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

move import

Tue, Aug 13, 8:25 PM
Harbormaster failed remote builds in B2930: Diff 3661 for D801: Initial k8s operator and split out of shared functionality!
Tue, Aug 13, 8:23 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Tue, Aug 13, 8:17 PM
Harbormaster failed remote builds in B2929: Diff 3660 for D801: Initial k8s operator and split out of shared functionality!
Tue, Aug 13, 8:11 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Tue, Aug 13, 8:05 PM
Harbormaster failed remote builds in B2928: Diff 3659 for D801: Initial k8s operator and split out of shared functionality!
Tue, Aug 13, 8:04 PM
natekupp added inline comments to D801: Initial k8s operator and split out of shared functionality.
Tue, Aug 13, 7:52 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Tue, Aug 13, 7:52 PM
schrockn requested changes to D809: Display required_resources in dagit.

So think we might to have this be a row-per required resource. That way we can add things like descriptions or metadata to the resource requirement.

Tue, Aug 13, 7:37 PM
schrockn accepted D808: Actually preserve the original config dict.

nice very surgical

Tue, Aug 13, 7:36 PM
natekupp accepted D808: Actually preserve the original config dict.
Tue, Aug 13, 7:35 PM
natekupp added a comment to D809: Display required_resources in dagit.

Looks good to me! Should we include a tooltip or something in the sidepanel UI to explain what required resources are?

Tue, Aug 13, 7:27 PM
sashank planned changes to D804: Create Scheduler GraphQL interface.
Tue, Aug 13, 6:55 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Rerun tests

Tue, Aug 13, 6:54 PM
Harbormaster failed remote builds in B2926: Diff 3657 for D804: Create Scheduler GraphQL interface!
Tue, Aug 13, 6:48 PM
Harbormaster failed remote builds in B2925: Diff 3656 for D809: Display required_resources in dagit!
Tue, Aug 13, 6:46 PM
prha updated the summary of D809: Display required_resources in dagit.
Tue, Aug 13, 6:44 PM
prha updated the summary of D809: Display required_resources in dagit.
Tue, Aug 13, 6:42 PM
prha updated the summary of D809: Display required_resources in dagit.
Tue, Aug 13, 6:41 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Use namedtuple instead of dict to store schedule and file_path

Tue, Aug 13, 6:41 PM
prha created D809: Display required_resources in dagit.
Tue, Aug 13, 6:39 PM
Harbormaster failed remote builds in B2924: Diff 3655 for D808: Actually preserve the original config dict!
Tue, Aug 13, 6:35 PM
max created D808: Actually preserve the original config dict.
Tue, Aug 13, 6:29 PM
Harbormaster failed remote builds in B2922: Diff 3653 for D798: Add Scheduler to dagit and DagsterGraphQLContext!
Tue, Aug 13, 6:27 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

make graphql

Tue, Aug 13, 6:26 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Use six.raise_from in SystemCronScheduler (from last diff)

Tue, Aug 13, 6:22 PM
Harbormaster failed remote builds in B2921: Diff 3651 for D798: Add Scheduler to dagit and DagsterGraphQLContext!
Tue, Aug 13, 6:21 PM
schrockn added inline comments to D791: Create Scheduler API.
Tue, Aug 13, 6:18 PM
sashank added inline comments to D791: Create Scheduler API.
Tue, Aug 13, 6:18 PM
schrockn added inline comments to D791: Create Scheduler API.
Tue, Aug 13, 6:16 PM
sashank committed R1:46421ee5154c: Create Scheduler API (authored by sashank).
Create Scheduler API
Tue, Aug 13, 6:16 PM
Sashank Thupukari <s@thupukari.com> closed D791: Create Scheduler API.
Tue, Aug 13, 6:16 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Make get_enabled_features() private

Tue, Aug 13, 6:14 PM
sashank updated the diff for D791: Create Scheduler API.

Rethrow exception

Tue, Aug 13, 6:10 PM
schrockn updated the summary of D795: Initial dagster-dbt prototype.
Tue, Aug 13, 6:06 PM
schrockn added a comment to D795: Initial dagster-dbt prototype.

Here is a video of this in action.

Tue, Aug 13, 6:06 PM
sashank committed R1:6c8085ab85af: Create script to generate library (authored by sashank).
Create script to generate library
Tue, Aug 13, 6:04 PM
Sashank Thupukari <s@thupukari.com> closed D759: Create script to generate library.
Tue, Aug 13, 6:04 PM
alangenfeld added inline comments to D791: Create Scheduler API.
Tue, Aug 13, 6:02 PM
schrockn added inline comments to D791: Create Scheduler API.
Tue, Aug 13, 6:01 PM
Harbormaster failed remote builds in B2917: Diff 3646 for D759: Create script to generate library!
Tue, Aug 13, 6:01 PM
sashank updated the diff for D791: Create Scheduler API.

Rerun tests

Tue, Aug 13, 5:57 PM
sashank updated the diff for D759: Create script to generate library.

Rerun tests

Tue, Aug 13, 5:56 PM
Harbormaster failed remote builds in B2916: Diff 3645 for D759: Create script to generate library!
Tue, Aug 13, 5:56 PM
Harbormaster failed remote builds in B2915: Diff 3644 for D791: Create Scheduler API!
Tue, Aug 13, 5:54 PM
sashank updated the diff for D759: Create script to generate library.

Change " -> '

Tue, Aug 13, 5:54 PM
schrockn accepted D759: Create script to generate library.

cool

Tue, Aug 13, 5:50 PM
Harbormaster failed remote builds in B2914: Diff 3643 for D801: Initial k8s operator and split out of shared functionality!
Tue, Aug 13, 5:50 PM
schrockn added inline comments to D759: Create script to generate library.
Tue, Aug 13, 5:50 PM
sashank updated the diff for D759: Create script to generate library.

Rerun tests

Tue, Aug 13, 5:49 PM
schrockn accepted D801: Initial k8s operator and split out of shared functionality.

great let's move forward. seems like next critical thing here will be to set up an integration test

Tue, Aug 13, 5:49 PM
sashank updated the diff for D791: Create Scheduler API.

Run tests

Tue, Aug 13, 5:46 PM
natekupp added inline comments to D801: Initial k8s operator and split out of shared functionality.
Tue, Aug 13, 5:37 PM
natekupp updated the diff for D801: Initial k8s operator and split out of shared functionality.

comments

Tue, Aug 13, 5:37 PM
bengotow committed R1:23e79f76d767: Add dagster-dbt to install_dev_python_modules (authored by bengotow).
Add dagster-dbt to install_dev_python_modules
Tue, Aug 13, 4:57 PM
Ben Gotow <ben@foundry376.com> closed D805: Add dagster-dbt to install_dev_python_modules.
Tue, Aug 13, 4:57 PM
alangenfeld abandoned D807: lakehouse demo for KT.

not for landing

Tue, Aug 13, 3:49 PM
Harbormaster failed remote builds in B2913: Diff 3641 for D807: lakehouse demo for KT!
Tue, Aug 13, 3:41 PM
alangenfeld created D807: lakehouse demo for KT.
Tue, Aug 13, 3:35 PM
alangenfeld requested changes to D804: Create Scheduler GraphQL interface.
Tue, Aug 13, 3:21 PM
Harbormaster failed remote builds in B2912: Diff 3640 for D802: Update docs and changelog for 0.5.6!
Tue, Aug 13, 3:19 PM
alangenfeld accepted D791: Create Scheduler API.

thumbsup

Tue, Aug 13, 3:15 PM
alangenfeld accepted D798: Add Scheduler to dagit and DagsterGraphQLContext.
Tue, Aug 13, 3:13 PM
max updated the diff for D802: Update docs and changelog for 0.5.6.

Add MarkdownMetadataEntryData

Tue, Aug 13, 3:11 PM
schrockn committed R1:1894d3397d81: disable coverage (authored by schrockn).
disable coverage
Tue, Aug 13, 3:09 PM
schrockn closed D806: disable coverage.
Tue, Aug 13, 3:09 PM
max added inline comments to D801: Initial k8s operator and split out of shared functionality.
Tue, Aug 13, 3:08 PM
alangenfeld accepted D806: disable coverage.
Tue, Aug 13, 2:55 PM
schrockn updated the diff for D806: disable coverage.

up

Tue, Aug 13, 2:53 PM
schrockn created D806: disable coverage.
Tue, Aug 13, 2:51 PM