Page MenuHomePhabricator
Feed Advanced Search

Aug 7 2019

max updated the diff for D771: Multiprocessing and Dask execution through Dagit.

Dask

Aug 7 2019, 4:06 PM
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.

Fix tests

Aug 7 2019, 12:35 AM
max updated the test plan for D771: Multiprocessing and Dask execution through Dagit.
Aug 7 2019, 12:12 AM

Aug 6 2019

max retitled D771: Multiprocessing and Dask execution through Dagit from Wip to Multiprocessing execution through Dagit.
Aug 6 2019, 11:59 PM
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.

Nits

Aug 6 2019, 11:59 PM
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.

Nits

Aug 6 2019, 10:47 PM
max updated the diff for D771: Multiprocessing and Dask execution through Dagit.

Fix sort, black

Aug 6 2019, 10:16 PM
max created D771: Multiprocessing and Dask execution through Dagit.
Aug 6 2019, 10:10 PM
max added inline comments to D752: Simplify engine interface.
Aug 6 2019, 10:01 PM
max updated the diff for D752: Simplify engine interface.

Rebase

Aug 6 2019, 9:57 PM
max updated the diff for D752: Simplify engine interface.

Utils

Aug 6 2019, 9:56 PM
max accepted D770: Remove unnecessary pins now that Airflow 1.10.4 is released.
Aug 6 2019, 9:17 PM
max accepted D761: Add SFTP solid.
Aug 6 2019, 7:23 PM
max updated the summary of D752: Simplify engine interface.
Aug 6 2019, 7:18 PM
max added a comment to D752: Simplify engine interface.

Yep, the second phase eliminates executor_config from RunConfig entirely, specifying it through the environment dict. It's key for this that all of our execution modalities use a single code path.

Aug 6 2019, 7:18 PM
max added a comment to D755: Rewrote airline demo readme.

I'd prefer to move this to docs/.rst and build the code in through the Sphinx build process -- then link to the docs from a very short README,md in the demo directory.

Aug 6 2019, 7:08 PM
max accepted D751: [dagster] error on unresolved inputs that cant be hydrated.
Aug 6 2019, 7:07 PM
max added a comment to D751: [dagster] error on unresolved inputs that cant be hydrated.

Maybe add a note to mark this error message -- eventually we will want to link to the docs, e.g. https://dagster.readthedocs.io/en/0.5.5/sections/learn/tutorial/types.html#input-hydration-config

Aug 6 2019, 7:06 PM

Aug 5 2019

max created D764: Fix typecast.
Aug 5 2019, 9:28 PM
max updated the diff for D752: Simplify engine interface.

Lint

Aug 5 2019, 5:25 PM
max retitled D752: Simplify engine interface from Wip to Simplify engine interface.
Aug 5 2019, 5:21 PM
max added inline comments to D761: Add SFTP solid.
Aug 5 2019, 5:15 PM
max added a comment to D762: New GE-Dagster integration prototype.

I think it's a little subtle to know what color to make / how to signal expectation failure

Aug 5 2019, 5:08 PM
max updated the diff for D752: Simplify engine interface.

Rebase

Aug 5 2019, 5:05 PM
max updated the diff for D752: Simplify engine interface.

Update docs

Aug 5 2019, 5:04 PM

Aug 1 2019

max created D752: Simplify engine interface.
Aug 1 2019, 9:12 PM

Jul 31 2019

max created D750: Fix undefined name on py2.
Jul 31 2019, 10:38 PM
max created D749: Fix PEP link.
Jul 31 2019, 10:18 PM

Jul 30 2019

max accepted D743: Fixes for dagster-airflow scaffold CLI.
Jul 30 2019, 11:09 PM
max accepted D742: [dagster] improve deps errors messages.
Jul 30 2019, 8:23 PM
max requested changes to D743: Fixes for dagster-airflow scaffold CLI.

I just want to avoid multiple conflicting implementations of get_system_temp_directory

Jul 30 2019, 8:23 PM

Jul 29 2019

max updated the diff for D734: Fix dagstermill reexecution.

Retvalue

Jul 29 2019, 10:35 PM
max updated the diff for D729: Changelog for 0.5.5.

Update for dagstermill reexecution

Jul 29 2019, 10:32 PM
max updated the diff for D734: Fix dagstermill reexecution.

Fix splat

Jul 29 2019, 10:30 PM
max updated the diff for D734: Fix dagstermill reexecution.

Typecheck

Jul 29 2019, 10:29 PM
max added inline comments to D734: Fix dagstermill reexecution.
Jul 29 2019, 10:26 PM
max updated the diff for D734: Fix dagstermill reexecution.

Use a namedtuple subclass

Jul 29 2019, 10:23 PM
max added inline comments to D734: Fix dagstermill reexecution.
Jul 29 2019, 10:17 PM
max updated the diff for D734: Fix dagstermill reexecution.

Rebase

Jul 29 2019, 10:14 PM
max updated the diff for D734: Fix dagstermill reexecution.

py27

Jul 29 2019, 10:05 PM
max added a comment to D734: Fix dagstermill reexecution.

Ack

Jul 29 2019, 10:02 PM
max updated the diff for D734: Fix dagstermill reexecution.

Rebase

Jul 29 2019, 10:01 PM
max updated the diff for D734: Fix dagstermill reexecution.

Fix return value

Jul 29 2019, 9:55 PM
max added reviewers for D734: Fix dagstermill reexecution: schrockn, Restricted Project.
Jul 29 2019, 9:52 PM
max updated the diff for D734: Fix dagstermill reexecution.

Actually cache on sub-pipeline creation

Jul 29 2019, 9:48 PM
max created D734: Fix dagstermill reexecution.
Jul 29 2019, 9:08 PM
max updated the diff for D727: Fix intermediate event messages.

Check against enum value

Jul 29 2019, 6:31 PM
max added inline comments to D727: Fix intermediate event messages.
Jul 29 2019, 6:27 PM
max created D729: Changelog for 0.5.5.
Jul 29 2019, 6:19 PM
max accepted D726: Separate "Loading..." and "Process starting..." status messages.

oh amazing, i thought this would be super hard for some reason

Jul 29 2019, 6:07 PM
max updated the test plan for D727: Fix intermediate event messages.
Jul 29 2019, 6:06 PM
max created D727: Fix intermediate event messages.
Jul 29 2019, 6:06 PM
max updated the diff for D721: Don't use a custom keyMapper.

Resolve issue with filtering nodes

Jul 29 2019, 3:49 AM
max added a comment to D721: Don't use a custom keyMapper.

and on FIrefox

Jul 29 2019, 3:37 AM
max added a comment to D721: Don't use a custom keyMapper.

This is broken in Chrome

Jul 29 2019, 3:35 AM
max added a comment to D721: Don't use a custom keyMapper.

The opposite, I think this might make table render performance worse; I haven't measured.

Jul 29 2019, 3:00 AM
max added a comment to D707: Lint.

@alangenfeld I'm not sure what package.json change you're thinking of here

Jul 29 2019, 3:00 AM
max added inline comments to D707: Lint.
Jul 29 2019, 2:59 AM
max created D725: Remove extraneous 'ms'.
Jul 29 2019, 2:49 AM

Jul 28 2019

max created D723: Copy to clipboard or follow link when relevant icon is clicked.
Jul 28 2019, 9:27 PM
max updated the test plan for D722: Better flexbox sizing for metadata entries.
Jul 28 2019, 9:19 PM
max updated the diff for D722: Better flexbox sizing for metadata entries.

Table width

Jul 28 2019, 9:18 PM
max created D722: Better flexbox sizing for metadata entries.
Jul 28 2019, 9:16 PM
max created D721: Don't use a custom keyMapper.
Jul 28 2019, 9:08 PM
max updated the summary of D720: Fix cell detail messages.
Jul 28 2019, 8:37 PM
max updated the diff for D720: Fix cell detail messages.

Add button to copy modal text

Jul 28 2019, 8:36 PM
max created D720: Fix cell detail messages.
Jul 28 2019, 8:27 PM
max created D719: Fix event handler.
Jul 28 2019, 3:26 AM

Jul 25 2019

max updated the diff for D708: Housekeeping.

Lint

Jul 25 2019, 11:57 PM
max updated the diff for D708: Housekeeping.

Black

Jul 25 2019, 11:41 PM
max created D708: Housekeeping.
Jul 25 2019, 11:32 PM
max updated the summary of D707: Lint.
Jul 25 2019, 10:18 PM
max created D707: Lint.
Jul 25 2019, 10:17 PM
max created D706: Improve release checklist.
Jul 25 2019, 9:46 PM
max accepted D699: [dagit] cli options from env.

Agree re: help text

Jul 25 2019, 8:47 PM
max created D704: Changelog for 0.5.4.
Jul 25 2019, 8:40 PM
max updated the diff for D700: Pin Airflow's broken transitive dependencies.

Fix quotes

Jul 25 2019, 6:59 PM
max updated the diff for D700: Pin Airflow's broken transitive dependencies.

Fixes

Jul 25 2019, 6:29 PM
max created D700: Pin Airflow's broken transitive dependencies.
Jul 25 2019, 5:38 PM
max accepted D685: Simplify Airflow operators.
Jul 25 2019, 4:58 PM
max created D697: Properly size metadata key cells.
Jul 25 2019, 1:04 AM
max accepted D696: Message for PIPELINE_INIT_FAILURE.
Jul 25 2019, 12:51 AM
max accepted D694: Update messages for PIPELINE_SUCESS and PIPELINE_FAILUR.
Jul 25 2019, 12:27 AM
max created D695: Add pointer to checked-in tutorial code.
Jul 25 2019, 12:27 AM
max updated the diff for D693: Add message for STEP_FAILED.

Fix test

Jul 25 2019, 12:15 AM
max created D693: Add message for STEP_FAILED.
Jul 25 2019, 12:12 AM
max added a comment to D692: Add padding for type viewer.

Jul 25 2019, 12:08 AM
max accepted D691: Add message for STEP_INPUT event.
Jul 25 2019, 12:06 AM
max added a reviewer for D692: Add padding for type viewer: bengotow.
Jul 25 2019, 12:05 AM
max created D692: Add padding for type viewer.
Jul 25 2019, 12:05 AM

Jul 24 2019

max updated the diff for D675: Add structured display for intermediate store events.

Nits

Jul 24 2019, 11:50 PM
max accepted D688: Add message for STEP_SUCCESS event type.
Jul 24 2019, 11:49 PM
max requested changes to D688: Add message for STEP_SUCCESS event type.
Jul 24 2019, 11:42 PM
max updated the diff for D675: Add structured display for intermediate store events.

Rebase & rework

Jul 24 2019, 11:32 PM
max updated the diff for D675: Add structured display for intermediate store events.

Nits

Jul 24 2019, 10:54 PM
max added inline comments to D688: Add message for STEP_SUCCESS event type.
Jul 24 2019, 10:44 PM
max accepted D686: Remove debugging comment in runs.py.
Jul 24 2019, 10:42 PM
max accepted D689: Add message for STEP_SKIPPED event.
Jul 24 2019, 10:42 PM
max accepted D690: Update client-side structured log presentation.
Jul 24 2019, 10:37 PM
max updated the diff for D675: Add structured display for intermediate store events.

Nits

Jul 24 2019, 10:34 PM