Page MenuHomePhabricator
Feed All Stories

Aug 13 2019

sashank updated the diff for D804: Create Scheduler GraphQL interface.

Remove timestamp from schedule filenames, removing the need for a wrapper around schedules in SystemCronScheduler

Aug 13 2019, 11:19 PM
max updated the diff for D802: Update docs and changelog for 0.5.6.

Rebase

Aug 13 2019, 11:17 PM
max committed R1:e51ac849fc83: Actually preserve the original config dict (authored by max).
Actually preserve the original config dict
Aug 13 2019, 11:17 PM
Max Gasner <max.gasner@gmail.com> closed D808: Actually preserve the original config dict.
Aug 13 2019, 11:17 PM
max abandoned D583: Add expectations pipeline with histograms.
Aug 13 2019, 11:14 PM
max updated the diff for D808: Actually preserve the original config dict.

Nits

Aug 13 2019, 11:10 PM
Harbormaster failed remote builds in B2940: Diff 3673 for D808: Actually preserve the original config dict!
Aug 13 2019, 11:08 PM
max accepted D812: [log sink] multiprocess executor.
Aug 13 2019, 11:08 PM
max accepted D811: [log sink] RunConfig log_sink.

can't wait for this to go

Aug 13 2019, 11:06 PM
max added inline comments to D808: Actually preserve the original config dict.
Aug 13 2019, 11:05 PM
max accepted D810: [log sink] move dagstermill xproc log to dagster.
Aug 13 2019, 11:05 PM
max updated the diff for D808: Actually preserve the original config dict.

Nits

Aug 13 2019, 11:02 PM
Harbormaster failed remote builds in B2938: Diff 3671 for D811: [log sink] RunConfig log_sink!
Aug 13 2019, 11:02 PM
Harbormaster failed remote builds in B2936: Diff 3669 for D789: Naive watcher for filesystem log storage!
Aug 13 2019, 10:58 PM
alangenfeld created D812: [log sink] multiprocess executor.
Aug 13 2019, 10:53 PM
alangenfeld created D811: [log sink] RunConfig log_sink.
Aug 13 2019, 10:52 PM
alangenfeld created D810: [log sink] move dagstermill xproc log to dagster.
Aug 13 2019, 10:51 PM
max updated the diff for D789: Naive watcher for filesystem log storage.

Cp

Aug 13 2019, 10:50 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Fix diff

Aug 13 2019, 10:44 PM
Harbormaster failed remote builds in B2934: Diff 3667 for D804: Create Scheduler GraphQL interface!
Aug 13 2019, 8:57 PM
sashank added inline comments to D804: Create Scheduler GraphQL interface.
Aug 13 2019, 8:56 PM
Harbormaster failed remote builds in B2933: Diff 3666 for D804: Create Scheduler GraphQL interface!
Aug 13 2019, 8:54 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

make graphql

Aug 13 2019, 8:51 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Change type of execution_params to String

Aug 13 2019, 8:48 PM
Nate Kupp <nate@elementl.com> closed D801: Initial k8s operator and split out of shared functionality.
Aug 13 2019, 8:43 PM
nate committed R1:0c6d7f755c79: Initial k8s operator and split out of shared functionality (authored by James Meickle <eronarn@gmail.com>).
Initial k8s operator and split out of shared functionality
Aug 13 2019, 8:43 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

ugh coveralls. rebase master

Aug 13 2019, 8:35 PM
sashank committed R1:a8adcc7d7e40: Add Scheduler to dagit and DagsterGraphQLContext (authored by sashank).
Add Scheduler to dagit and DagsterGraphQLContext
Aug 13 2019, 8:34 PM
Sashank Thupukari <s@thupukari.com> closed D798: Add Scheduler to dagit and DagsterGraphQLContext.
Aug 13 2019, 8:34 PM
Harbormaster failed remote builds in B2931: Diff 3662 for D801: Initial k8s operator and split out of shared functionality!
Aug 13 2019, 8:33 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

move import

Aug 13 2019, 8:25 PM
Harbormaster failed remote builds in B2930: Diff 3661 for D801: Initial k8s operator and split out of shared functionality!
Aug 13 2019, 8:23 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Aug 13 2019, 8:17 PM
Harbormaster failed remote builds in B2929: Diff 3660 for D801: Initial k8s operator and split out of shared functionality!
Aug 13 2019, 8:11 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Aug 13 2019, 8:05 PM
Harbormaster failed remote builds in B2928: Diff 3659 for D801: Initial k8s operator and split out of shared functionality!
Aug 13 2019, 8:04 PM
nate added inline comments to D801: Initial k8s operator and split out of shared functionality.
Aug 13 2019, 7:52 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

up

Aug 13 2019, 7:52 PM
schrockn requested changes to D809: Display required_resources in dagit.

So think we might to have this be a row-per required resource. That way we can add things like descriptions or metadata to the resource requirement.

Aug 13 2019, 7:37 PM
schrockn accepted D808: Actually preserve the original config dict.

nice very surgical

Aug 13 2019, 7:36 PM
nate accepted D808: Actually preserve the original config dict.
Aug 13 2019, 7:35 PM
nate added a comment to D809: Display required_resources in dagit.

Looks good to me! Should we include a tooltip or something in the sidepanel UI to explain what required resources are?

Aug 13 2019, 7:27 PM
sashank planned changes to D804: Create Scheduler GraphQL interface.
Aug 13 2019, 6:55 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Rerun tests

Aug 13 2019, 6:54 PM
Harbormaster failed remote builds in B2926: Diff 3657 for D804: Create Scheduler GraphQL interface!
Aug 13 2019, 6:48 PM
Harbormaster failed remote builds in B2925: Diff 3656 for D809: Display required_resources in dagit!
Aug 13 2019, 6:46 PM
prha updated the summary of D809: Display required_resources in dagit.
Aug 13 2019, 6:44 PM
prha updated the summary of D809: Display required_resources in dagit.
Aug 13 2019, 6:42 PM
prha updated the summary of D809: Display required_resources in dagit.
Aug 13 2019, 6:41 PM
sashank updated the diff for D804: Create Scheduler GraphQL interface.

Use namedtuple instead of dict to store schedule and file_path

Aug 13 2019, 6:41 PM
prha created D809: Display required_resources in dagit.
Aug 13 2019, 6:39 PM
Harbormaster failed remote builds in B2924: Diff 3655 for D808: Actually preserve the original config dict!
Aug 13 2019, 6:35 PM
max created D808: Actually preserve the original config dict.
Aug 13 2019, 6:29 PM
Harbormaster failed remote builds in B2922: Diff 3653 for D798: Add Scheduler to dagit and DagsterGraphQLContext!
Aug 13 2019, 6:27 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

make graphql

Aug 13 2019, 6:26 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Use six.raise_from in SystemCronScheduler (from last diff)

Aug 13 2019, 6:22 PM
Harbormaster failed remote builds in B2921: Diff 3651 for D798: Add Scheduler to dagit and DagsterGraphQLContext!
Aug 13 2019, 6:21 PM
schrockn added inline comments to D791: Create Scheduler API.
Aug 13 2019, 6:18 PM
sashank added inline comments to D791: Create Scheduler API.
Aug 13 2019, 6:18 PM
schrockn added inline comments to D791: Create Scheduler API.
Aug 13 2019, 6:16 PM
sashank committed R1:46421ee5154c: Create Scheduler API (authored by sashank).
Create Scheduler API
Aug 13 2019, 6:16 PM
Sashank Thupukari <s@thupukari.com> closed D791: Create Scheduler API.
Aug 13 2019, 6:16 PM
sashank updated the diff for D798: Add Scheduler to dagit and DagsterGraphQLContext.

Make get_enabled_features() private

Aug 13 2019, 6:14 PM
sashank updated the diff for D791: Create Scheduler API.

Rethrow exception

Aug 13 2019, 6:10 PM
schrockn updated the summary of D795: Initial dagster-dbt prototype.
Aug 13 2019, 6:06 PM
schrockn added a comment to D795: Initial dagster-dbt prototype.

Here is a video of this in action.

Aug 13 2019, 6:06 PM
sashank committed R1:6c8085ab85af: Create script to generate library (authored by sashank).
Create script to generate library
Aug 13 2019, 6:04 PM
Sashank Thupukari <s@thupukari.com> closed D759: Create script to generate library.
Aug 13 2019, 6:04 PM
alangenfeld added inline comments to D791: Create Scheduler API.
Aug 13 2019, 6:02 PM
schrockn added inline comments to D791: Create Scheduler API.
Aug 13 2019, 6:01 PM
Harbormaster failed remote builds in B2917: Diff 3646 for D759: Create script to generate library!
Aug 13 2019, 6:01 PM
sashank updated the diff for D791: Create Scheduler API.

Rerun tests

Aug 13 2019, 5:57 PM
sashank updated the diff for D759: Create script to generate library.

Rerun tests

Aug 13 2019, 5:56 PM
Harbormaster failed remote builds in B2916: Diff 3645 for D759: Create script to generate library!
Aug 13 2019, 5:56 PM
Harbormaster failed remote builds in B2915: Diff 3644 for D791: Create Scheduler API!
Aug 13 2019, 5:54 PM
sashank updated the diff for D759: Create script to generate library.

Change " -> '

Aug 13 2019, 5:54 PM
schrockn accepted D759: Create script to generate library.

cool

Aug 13 2019, 5:50 PM
Harbormaster failed remote builds in B2914: Diff 3643 for D801: Initial k8s operator and split out of shared functionality!
Aug 13 2019, 5:50 PM
schrockn added inline comments to D759: Create script to generate library.
Aug 13 2019, 5:50 PM
sashank updated the diff for D759: Create script to generate library.

Rerun tests

Aug 13 2019, 5:49 PM
schrockn accepted D801: Initial k8s operator and split out of shared functionality.

great let's move forward. seems like next critical thing here will be to set up an integration test

Aug 13 2019, 5:49 PM
sashank updated the diff for D791: Create Scheduler API.

Run tests

Aug 13 2019, 5:46 PM
nate added inline comments to D801: Initial k8s operator and split out of shared functionality.
Aug 13 2019, 5:37 PM
nate updated the diff for D801: Initial k8s operator and split out of shared functionality.

comments

Aug 13 2019, 5:37 PM
bengotow committed R1:23e79f76d767: Add dagster-dbt to install_dev_python_modules (authored by bengotow).
Add dagster-dbt to install_dev_python_modules
Aug 13 2019, 4:57 PM
Ben Gotow <ben@foundry376.com> closed D805: Add dagster-dbt to install_dev_python_modules.
Aug 13 2019, 4:57 PM
alangenfeld abandoned D807: lakehouse demo for KT.

not for landing

Aug 13 2019, 3:49 PM
Harbormaster failed remote builds in B2913: Diff 3641 for D807: lakehouse demo for KT!
Aug 13 2019, 3:41 PM
alangenfeld created D807: lakehouse demo for KT.
Aug 13 2019, 3:35 PM
alangenfeld requested changes to D804: Create Scheduler GraphQL interface.
Aug 13 2019, 3:21 PM
Harbormaster failed remote builds in B2912: Diff 3640 for D802: Update docs and changelog for 0.5.6!
Aug 13 2019, 3:19 PM
alangenfeld accepted D791: Create Scheduler API.

thumbsup

Aug 13 2019, 3:15 PM
alangenfeld accepted D798: Add Scheduler to dagit and DagsterGraphQLContext.
Aug 13 2019, 3:13 PM
max updated the diff for D802: Update docs and changelog for 0.5.6.

Add MarkdownMetadataEntryData

Aug 13 2019, 3:11 PM
schrockn committed R1:1894d3397d81: disable coverage (authored by schrockn).
disable coverage
Aug 13 2019, 3:09 PM
schrockn closed D806: disable coverage.
Aug 13 2019, 3:09 PM
max added inline comments to D801: Initial k8s operator and split out of shared functionality.
Aug 13 2019, 3:08 PM
alangenfeld accepted D806: disable coverage.
Aug 13 2019, 2:55 PM
schrockn updated the diff for D806: disable coverage.

up

Aug 13 2019, 2:53 PM
schrockn created D806: disable coverage.
Aug 13 2019, 2:51 PM