Page MenuHomePhabricator
Feed Advanced Search

Today

alangenfeld updated the summary of D1291: report pipelines as failure on uncaught exception.
Tue, Oct 15, 9:27 PM
alangenfeld updated the diff for D1291: report pipelines as failure on uncaught exception.

cleaner

Tue, Oct 15, 9:25 PM
alangenfeld created D1291: report pipelines as failure on uncaught exception.
Tue, Oct 15, 9:21 PM
alangenfeld accepted D1287: Rename pandas_hello_world_pipeline_no_config to pandas_hello_world_pipeline_with_read_csv.

ok

Tue, Oct 15, 8:12 PM
alangenfeld committed R1:294bd8b44b2d: [airline demo] update guide for python 3 req (authored by alangenfeld).
[airline demo] update guide for python 3 req
Tue, Oct 15, 8:12 PM
alangenfeld closed D1285: [airline demo] update guide for python 3 req.
Tue, Oct 15, 8:12 PM
alangenfeld accepted D1281: Allow custom type_check on PythonObjectType.

alright, fix typo before land

Tue, Oct 15, 8:10 PM
alangenfeld abandoned D1290: dont pin exact enum-compat ver.
Tue, Oct 15, 2:46 PM
alangenfeld created D1290: dont pin exact enum-compat ver.
Tue, Oct 15, 2:42 PM

Yesterday

alangenfeld created D1285: [airline demo] update guide for python 3 req.
Mon, Oct 14, 11:43 PM
alangenfeld added a comment to D1284: Update wording for Any type in docs.

😿

Mon, Oct 14, 10:00 PM
alangenfeld updated the diff for D1274: fix output materializations for composite solids.

black n lint

Mon, Oct 14, 9:46 PM
alangenfeld updated the diff for D1274: fix output materializations for composite solids.

now with less infinite loops

Mon, Oct 14, 9:04 PM
alangenfeld accepted D1282: Minor improvements to phw demo.
Mon, Oct 14, 8:30 PM
alangenfeld added inline comments to D1281: Allow custom type_check on PythonObjectType.
Mon, Oct 14, 7:12 PM
alangenfeld updated the diff for D1274: fix output materializations for composite solids.

changes.md

Mon, Oct 14, 7:08 PM
alangenfeld updated the diff for D1274: fix output materializations for composite solids.

the fix

Mon, Oct 14, 7:04 PM
alangenfeld committed R1:49ab884411dd: [RFC] dagster-graphql --remote HOST (authored by alangenfeld).
[RFC] dagster-graphql --remote HOST
Mon, Oct 14, 6:44 PM
alangenfeld closed D1263: [RFC] dagster-graphql --remote HOST.
Mon, Oct 14, 6:44 PM
alangenfeld added a comment to D1273: Improve type inference.

I think i am ok with the overall idea, especially once we get strict_mode or something akin in place. I will leave this open for now to give @schrockn another chance to take a look

Mon, Oct 14, 6:38 PM
alangenfeld added inline comments to D1273: Improve type inference.
Mon, Oct 14, 6:34 PM
alangenfeld added inline comments to D1273: Improve type inference.
Mon, Oct 14, 6:33 PM
alangenfeld closed D1266: allow composites in execute_solid.
Mon, Oct 14, 6:25 PM
alangenfeld committed R1:860fa42d374c: allow composites in execute_solid (authored by alangenfeld).
allow composites in execute_solid
Mon, Oct 14, 6:25 PM
alangenfeld updated the diff for D1263: [RFC] dagster-graphql --remote HOST.

more useful sanity check endpoint

Mon, Oct 14, 6:22 PM
alangenfeld updated the diff for D1266: allow composites in execute_solid.

rebase

Mon, Oct 14, 6:02 PM
alangenfeld committed R1:577a6fcf9ca0: [core] autoalias in composition functions (authored by alangenfeld).
[core] autoalias in composition functions
Mon, Oct 14, 5:48 PM
alangenfeld closed D1261: [core] autoalias in composition functions.
Mon, Oct 14, 5:48 PM
alangenfeld added a comment to D1242: RFC: Add dagster schedule wipe command.

ill file an issue

Mon, Oct 14, 5:33 PM
alangenfeld accepted D1242: RFC: Add dagster schedule wipe command.

we should probably go through and gate all the wipe commands with a user prompt for a string like DELETE

Mon, Oct 14, 5:33 PM
alangenfeld committed R1:f1b5c3d973af: fix airline demo docs (authored by alangenfeld).
fix airline demo docs
Mon, Oct 14, 5:15 PM
alangenfeld closed D1280: fix airline demo docs.
Mon, Oct 14, 5:15 PM
alangenfeld requested changes to D1276: Add limit to SchedulesRootQuery.
Mon, Oct 14, 4:50 PM
alangenfeld added inline comments to D1278: [RFC] Show run count in dagit.
Mon, Oct 14, 4:46 PM
alangenfeld accepted D1267: [dagster-aws] Permit switching repository to a different dir (#1826).
Mon, Oct 14, 4:44 PM
alangenfeld planned changes to D1274: fix output materializations for composite solids.
Mon, Oct 14, 4:31 PM
alangenfeld commandeered D1274: fix output materializations for composite solids.
Mon, Oct 14, 4:31 PM
alangenfeld accepted D1258: implement compute log tailing in python (enable windows mirror).

its kinda gross but nothing objectionable

Mon, Oct 14, 4:21 PM
alangenfeld requested changes to D1242: RFC: Add dagster schedule wipe command.
Mon, Oct 14, 4:13 PM
alangenfeld added a comment to D1242: RFC: Add dagster schedule wipe command.

schedule metadata files for schedules in the current repository
all dagster-created cron tabs, regardless of which repository they are from

Mon, Oct 14, 4:13 PM
alangenfeld requested changes to D1278: [RFC] Show run count in dagit.

This is great but since it doubles the number of "runs w/ filters" methods I am going to push for the long term sustainable approach up front. This will also fix the current short coming that we can only filter one dimension at a time.

Mon, Oct 14, 4:04 PM
alangenfeld created D1280: fix airline demo docs.
Mon, Oct 14, 3:52 PM
alangenfeld updated the diff for D1261: [core] autoalias in composition functions.

up

Mon, Oct 14, 3:49 PM
alangenfeld added a comment to D1273: Improve type inference.

Given that we currently don't catch custom types having serialization problems til runtime - this feature could make it very easy to accidentally introduce a problematic output to a solid in a big pipeline and not catch it til N hours in to the job when it fails. Am I mistaken and we catch these errors earlier? If not I think it would be better to add that safeguard in place before we auto up new types this aggressively.

Mon, Oct 14, 3:47 PM
alangenfeld updated the diff for D1261: [core] autoalias in composition functions.

rebase

Mon, Oct 14, 3:11 PM

Fri, Oct 11

alangenfeld accepted D1271: Fix infinite recursion in inst_data property of SQLite run storage.

gogogo

Fri, Oct 11, 9:58 PM
alangenfeld updated the diff for D1261: [core] autoalias in composition functions.

tests

Fri, Oct 11, 9:58 PM
alangenfeld updated the diff for D1266: allow composites in execute_solid.

is_or_descends_from on SolidHandle

Fri, Oct 11, 8:58 PM
alangenfeld retitled D1261: [core] autoalias in composition functions from [RFC] autoalias option on composition functions to [core] autoalias in composition functions.
Fri, Oct 11, 8:17 PM
alangenfeld updated the diff for D1266: allow composites in execute_solid.

lint

Fri, Oct 11, 8:14 PM
alangenfeld updated the diff for D1266: allow composites in execute_solid.

parse string in to SolidHandle

Fri, Oct 11, 8:14 PM
alangenfeld updated the diff for D1266: allow composites in execute_solid.

shift the results APIs around to better handle composites

Fri, Oct 11, 7:54 PM
alangenfeld accepted D1268: Allow pytest to handle for slower test completion.
Fri, Oct 11, 6:43 PM
alangenfeld updated the diff for D1261: [core] autoalias in composition functions.

remove flag, update docs and tests

Fri, Oct 11, 6:06 PM
alangenfeld accepted D1265: Make construction of ConfigurableClass-derived classes less error prone.

works for me

Fri, Oct 11, 3:49 PM
alangenfeld added inline comments to D1266: allow composites in execute_solid.
Fri, Oct 11, 3:44 PM
alangenfeld created D1266: allow composites in execute_solid.
Fri, Oct 11, 3:31 PM

Thu, Oct 10

alangenfeld committed R1:9d2beb1f272e: [s3] cp_object support (authored by alangenfeld).
[s3] cp_object support
Thu, Oct 10, 9:02 PM
alangenfeld closed D1259: [s3] cp_object support.
Thu, Oct 10, 9:02 PM
alangenfeld updated the diff for D1263: [RFC] dagster-graphql --remote HOST.

isort skip

Thu, Oct 10, 8:43 PM
alangenfeld updated the diff for D1263: [RFC] dagster-graphql --remote HOST.

py2

Thu, Oct 10, 8:27 PM
alangenfeld created D1263: [RFC] dagster-graphql --remote HOST.
Thu, Oct 10, 8:02 PM
alangenfeld updated the diff for D1261: [core] autoalias in composition functions.

rebase

Thu, Oct 10, 5:30 PM
alangenfeld updated the diff for D1259: [s3] cp_object support.

rebase

Thu, Oct 10, 5:30 PM
alangenfeld committed R1:1d6ebe8dd814: remove apt-get steps from dagit (authored by alangenfeld).
remove apt-get steps from dagit
Thu, Oct 10, 5:30 PM
alangenfeld closed D1262: remove apt-get steps from dagit.
Thu, Oct 10, 5:30 PM
alangenfeld added a reviewer for D1262: remove apt-get steps from dagit: Restricted Project.
Thu, Oct 10, 5:21 PM
alangenfeld created D1262: remove apt-get steps from dagit.
Thu, Oct 10, 5:15 PM
alangenfeld created D1261: [core] autoalias in composition functions.
Thu, Oct 10, 4:35 PM
alangenfeld added a reviewer for D1260: Add css ellipsis for run pipeline name: bengotow.

@bengotow you have thoughts here?

Thu, Oct 10, 3:37 PM
alangenfeld updated the diff for D1259: [s3] cp_object support.

rebase

Thu, Oct 10, 3:24 PM
alangenfeld added inline comments to D1259: [s3] cp_object support.
Thu, Oct 10, 12:23 AM
alangenfeld updated the summary of D1259: [s3] cp_object support.
Thu, Oct 10, 12:21 AM
alangenfeld updated the diff for D1259: [s3] cp_object support.

fixes

Thu, Oct 10, 12:16 AM
alangenfeld committed R1:8abbfea5c78e: [take 2] capture_dauphin_error returns PythonError (authored by alangenfeld).
[take 2] capture_dauphin_error returns PythonError
Thu, Oct 10, 12:11 AM
alangenfeld closed D1256: [take 2] capture_dauphin_error returns PythonError.
Thu, Oct 10, 12:11 AM
alangenfeld updated the diff for D1259: [s3] cp_object support.

more reliable way to get directory / path for previous run

Thu, Oct 10, 12:04 AM

Wed, Oct 9

alangenfeld updated the diff for D1259: [s3] cp_object support.

move impl up in class heirarchy

Wed, Oct 9, 11:39 PM
alangenfeld created D1259: [s3] cp_object support.
Wed, Oct 9, 11:29 PM
alangenfeld committed R1:4c7598a4d58d: DagsterExecutionStepNotFoundError report all missing steps (authored by alangenfeld).
DagsterExecutionStepNotFoundError report all missing steps
Wed, Oct 9, 9:31 PM
alangenfeld closed D1247: DagsterExecutionStepNotFoundError report all missing steps.
Wed, Oct 9, 9:31 PM
alangenfeld accepted D1257: Fixes for @solid documentation.
Wed, Oct 9, 9:11 PM
alangenfeld accepted D1255: ensure `on_complete` called for completed compute log subscriptions.
Wed, Oct 9, 9:10 PM
alangenfeld accepted D1254: Refresh installation docs.
Wed, Oct 9, 9:09 PM
alangenfeld created D1256: [take 2] capture_dauphin_error returns PythonError.
Wed, Oct 9, 8:56 PM
alangenfeld added inline comments to D1254: Refresh installation docs.
Wed, Oct 9, 6:57 PM
alangenfeld accepted D1253: Revert "Revert "Consolidate split panel handling, save divider locations to local storage"".

round 2 lets go

Wed, Oct 9, 6:30 PM
alangenfeld accepted D1252: Add test demonstrating input injection for List[String].
Wed, Oct 9, 6:29 PM
alangenfeld accepted D1250: Rename PySpark Dataframe and use dense config for join.
Wed, Oct 9, 6:27 PM
alangenfeld accepted D1245: Change default scrolling behavior.

whynot

Wed, Oct 9, 6:27 PM
alangenfeld added inline comments to D1251: [RFC] Alias Builder.
Wed, Oct 9, 5:44 PM

Tue, Oct 8

alangenfeld added a reviewer for D1247: DagsterExecutionStepNotFoundError report all missing steps: Restricted Project.
Tue, Oct 8, 5:15 PM
alangenfeld created D1247: DagsterExecutionStepNotFoundError report all missing steps.
Tue, Oct 8, 5:13 PM
alangenfeld closed D1232: [RFC] capture_dauphin_error returns PythonError.
Tue, Oct 8, 4:28 PM
alangenfeld committed R1:65503e06f77d: [RFC] capture_dauphin_error returns PythonError (authored by alangenfeld).
[RFC] capture_dauphin_error returns PythonError
Tue, Oct 8, 4:28 PM
alangenfeld updated the diff for D1232: [RFC] capture_dauphin_error returns PythonError.

rebase

Tue, Oct 8, 3:46 PM

Mon, Oct 7

alangenfeld accepted D1219: Change compute logs graphql endpoint to query stdout/stderr separately.
Mon, Oct 7, 8:24 PM
alangenfeld accepted D1238: Update release notes with scheduler changes.
Mon, Oct 7, 6:53 PM
alangenfeld accepted D1236: Remove [Experimental] from scheduler commands.
Mon, Oct 7, 6:53 PM
alangenfeld retitled D1232: [RFC] capture_dauphin_error returns PythonError from capture_dauphin_error returns PythonError to [RFC] capture_dauphin_error returns PythonError.
Mon, Oct 7, 5:46 PM