Fixup
Feed Advanced Search
Fri, Aug 16
Fri, Aug 16
max added reviewers for D789: Naive watcher for filesystem log storage: alangenfeld, Restricted Project.
max retitled D789: Naive watcher for filesystem log storage from Wip to Naive watcher for filesystem log storage.
max added a comment to D833: Update Flask dependency.
Do we know what is actually breaking?
Thu, Aug 15
Thu, Aug 15
Wed, Aug 14
Wed, Aug 14
max added inline comments to D815: Promote some step events to INFO.
max added a comment to D815: Promote some step events to INFO.
13:08 $ dagster pipeline execute hello_world_pipeline
2019-08-14 13:08:29 - dagster - INFO -
orig_message = "Started execution of step \"hello_world.compute\"."
log_message_id = "76a5859e-f570-4149-8abb-5827edb5dc88"
log_timestamp = "2019-08-14T20:08:29.680115"
run_id = "0d373766-6ca8-4f54-a558-8dc503cb285e"
pipeline = "hello_world_pipeline"
execution_epoch_time = 1565813309.6636858
step_key = "hello_world.compute"
solid = "hello_world"
solid_definition = "hello_world"
dagster_event = {"event_specific_data": null, "event_type_value": "STEP_START", "logging_tags": {"execution_epoch_time": 1565813309.6636858, "pipeline": "hello_world_pipeline", "solid": "hello_world", "solid_definition": "hello_world", "step_key": "hello_world.compute"}, "message": "Started execution of step \"hello_world.compute\".", "pipeline_name": "hello_world_pipeline", "solid_handle": ["hello_world", "hello_world", null], "step_key": "hello_world.compute", "step_kind_value": "COMPUTE"}
pipeline_name = "hello_world_pipeline"
2019-08-14 13:08:29 - dagster - INFO -
orig_message = "Yielded output \"result\" of type \"Any\". (Type check passed)."
log_message_id = "c2e86805-48d0-4ff9-a319-259e028bc697"
log_timestamp = "2019-08-14T20:08:29.685378"
run_id = "0d373766-6ca8-4f54-a558-8dc503cb285e"
pipeline = "hello_world_pipeline"
execution_epoch_time = 1565813309.6636858
step_key = "hello_world.compute"
solid = "hello_world"
solid_definition = "hello_world"
dagster_event = {"event_specific_data": [["hello_world.compute", "result"], null, [true, "result", null, []]], "event_type_value": "STEP_OUTPUT", "logging_tags": {"execution_epoch_time": 1565813309.6636858, "pipeline": "hello_world_pipeline", "solid": "hello_world", "solid_definition": "hello_world", "step_key": "hello_world.compute"}, "message": "Yielded output \"result\" of type \"Any\". (Type check passed).", "pipeline_name": "hello_world_pipeline", "solid_handle": ["hello_world", "hello_world", null], "step_key": "hello_world.compute", "step_kind_value": "COMPUTE"}
pipeline_name = "hello_world_pipeline"
2019-08-14 13:08:29 - dagster - INFO -
orig_message = "Finished execution of step \"hello_world.compute\" in 0.92ms."
log_message_id = "33ddba7c-b6c7-421f-a906-4a0f9f942169"
log_timestamp = "2019-08-14T20:08:29.685813"
run_id = "0d373766-6ca8-4f54-a558-8dc503cb285e"
pipeline = "hello_world_pipeline"
execution_epoch_time = 1565813309.6636858
step_key = "hello_world.compute"
solid = "hello_world"
solid_definition = "hello_world"
dagster_event = {"event_specific_data": [0.9248830028809607], "event_type_value": "STEP_SUCCESS", "logging_tags": {"execution_epoch_time": 1565813309.6636858, "pipeline": "hello_world_pipeline", "solid": "hello_world", "solid_definition": "hello_world", "step_key": "hello_world.compute"}, "message": "Finished execution of step \"hello_world.compute\" in 0.92ms.", "pipeline_name": "hello_world_pipeline", "solid_handle": ["hello_world", "hello_world", null], "step_key": "hello_world.compute", "step_kind_value": "COMPUTE"}
pipeline_name = "hello_world_pipeline"max retitled D815: Promote some step events to INFO from Drop the default console logger log level to DEBUG to Promote some step events to INFO.
max updated the diff for D817: Terminate watchdog when the child process exits.
Add basic test for cli wrapper
max updated the diff for D817: Terminate watchdog when the child process exits.
Rebase
max added a comment to D815: Promote some step events to INFO.
Alternatively, we could have a CLI-specific logger that did some cute display stuff (could print out something like . . . . or take verbose options)
max updated the diff for D814: Keep the abspath to repository.yaml around in ExecutionTargetHandle.
Basic test for output notebook reexecution
max added a comment to D815: Promote some step events to INFO.
Just going to note that they are very, very noisy
Tue, Aug 13
Tue, Aug 13
max added inline comments to D808: Actually preserve the original config dict.
max updated the diff for D802: Update docs and changelog for 0.5.6.
Add MarkdownMetadataEntryData
max added inline comments to D801: Initial k8s operator and split out of shared functionality.
Mon, Aug 12
Mon, Aug 12
max updated the diff for D799: Don't run docker-compose fixture on buildkite.
Lint
max added inline comments to D759: Create script to generate library.
Fri, Aug 9
Fri, Aug 9
max added inline comments to D774: Refactor PipelineRunStorage.
Thu, Aug 8
Thu, Aug 8
max added inline comments to D774: Refactor PipelineRunStorage.
max added inline comments to D771: Multiprocessing and Dask execution through Dagit.
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Respond to feedback
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Fix import
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Fix import
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Respond to comments
Wed, Aug 7
Wed, Aug 7
max added inline comments to D771: Multiprocessing and Dask execution through Dagit.
max added a comment to D766: [dagster-graphql] predefined queries.
this is so fancy and nice
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Undebug
max added inline comments to D771: Multiprocessing and Dask execution through Dagit.
max updated the summary of D771: Multiprocessing and Dask execution through Dagit.
max added reviewers for D771: Multiprocessing and Dask execution through Dagit: alangenfeld, natekupp, schrockn, Restricted Project.
max retitled D771: Multiprocessing and Dask execution through Dagit from Multiprocessing execution through Dagit to Multiprocessing and Dask execution through Dagit.
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Nits
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Multiproc fixes
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Fixup config
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Properly nest config
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.
Name collision