Page MenuHomePhabricator
Feed Advanced Search

Yesterday

yuhan planned changes to D2460: #2346-2 [RFC] pass tags and stepkeys to playground.
Wed, Apr 8, 9:02 PM
yuhan planned changes to D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 8, 9:01 PM
yuhan updated the summary of D2472: #2352 Fix incorrect step state after re-execution.
Wed, Apr 8, 3:55 AM
yuhan created D2472: #2352 Fix incorrect step state after re-execution.
Wed, Apr 8, 3:45 AM
yuhan retitled D2460: #2346-2 [RFC] pass tags and stepkeys to playground from #2346-2 [run grouping] pass tags and stepkeys to playground to #2346-2 [RFC] pass tags and stepkeys to playground.
Wed, Apr 8, 1:32 AM
yuhan updated the diff for D2460: #2346-2 [RFC] pass tags and stepkeys to playground.

up

Wed, Apr 8, 1:31 AM
yuhan retitled D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run from #2346-1 [run grouping] multi-step (arbitrary subset) re-execution through dagit Run to #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 8, 1:27 AM
yuhan added inline comments to D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 8, 1:15 AM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

update. still waiting for D2364 to address the confusion between FilterInputGroup and Step Subset selector

Wed, Apr 8, 1:14 AM

Tue, Apr 7

yuhan accepted D2444: Add query to get runs grouped by root run id.
Tue, Apr 7, 5:03 PM
yuhan retitled D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run from #2346-1 [run groupnig] multi-step (arbitrary subset) re-execution through dagit Run to #2346-1 [run grouping] multi-step (arbitrary subset) re-execution through dagit Run.
Tue, Apr 7, 1:47 AM
yuhan updated subscribers of D2460: #2346-2 [RFC] pass tags and stepkeys to playground.

cc @nate this is a RFC to pass run grouping info to Playground -- so when we want to change some of the configs but still re-execute a pipeline (or a subset), we can still link the run with its group.
mainly for https://github.com/dagster-io/dagster/issues/1993
how do you feel about the new flow?

Tue, Apr 7, 1:44 AM
yuhan updated the summary of D2460: #2346-2 [RFC] pass tags and stepkeys to playground.
Tue, Apr 7, 1:40 AM
yuhan created D2460: #2346-2 [RFC] pass tags and stepkeys to playground.
Tue, Apr 7, 1:35 AM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

stack

Tue, Apr 7, 1:33 AM

Mon, Apr 6

yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Mon, Apr 6, 5:59 PM
yuhan added inline comments to D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Mon, Apr 6, 4:45 PM
yuhan retitled D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run from [WIP] #1993 [run groupnig] cache capability for solids to #2346-1 [run groupnig] multi-step (arbitrary subset) re-execution through dagit Run.
Mon, Apr 6, 4:41 PM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

enable multi-step re-execution from dagit

Mon, Apr 6, 4:30 PM
yuhan added inline comments to D2444: Add query to get runs grouped by root run id.
Mon, Apr 6, 1:21 AM

Fri, Apr 3

yuhan retitled D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run from #1993 [run groupnig] cache capability for solids to [WIP] #1993 [run groupnig] cache capability for solids.
Fri, Apr 3, 8:42 PM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

single-step retry: add parent/run id tags

Fri, Apr 3, 8:40 PM

Thu, Apr 2

yuhan added inline comments to D2426: Changelog for 0.7.6.
Thu, Apr 2, 11:56 PM
yuhan added inline comments to D2426: Changelog for 0.7.6.
Thu, Apr 2, 11:45 PM

Wed, Apr 1

yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 6:40 PM
yuhan added inline comments to D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 6:35 PM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

simplify pipeline code

Wed, Apr 1, 6:26 PM
yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 6:26 PM
yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 5:05 PM
yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 5:05 PM
yuhan updated the diff for D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.

up

Wed, Apr 1, 5:01 PM
yuhan updated the summary of D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 4:54 PM
yuhan created D2405: #2346-1 [RFC] multi-step (arbitrary subset) re-execution through dagit Run.
Wed, Apr 1, 4:47 PM

Tue, Mar 31

yuhan accepted D2391: Fix docs makefile.
Tue, Mar 31, 8:38 PM
yuhan committed R1:cef077f237d4: fix gatsby GA plugin (authored by yuhan).
fix gatsby GA plugin
Tue, Mar 31, 5:31 AM
yuhan closed D2379: fix gatsby GA plugin.
Tue, Mar 31, 5:31 AM
yuhan updated the summary of D2379: fix gatsby GA plugin.
Tue, Mar 31, 12:13 AM
yuhan created D2379: fix gatsby GA plugin.
Tue, Mar 31, 12:12 AM

Fri, Mar 27

yuhan committed R1:eb1f5aecd90a: [doc] add GA to docs.dagster.io (authored by yuhan).
[doc] add GA to docs.dagster.io
Fri, Mar 27, 8:33 PM
yuhan closed D2346: [doc] add GA to docs.dagster.io.
Fri, Mar 27, 8:33 PM
yuhan committed R1:8104e135f3ee: #2320 add root_run_id to group related runs (authored by yuhan).
#2320 add root_run_id to group related runs
Fri, Mar 27, 8:08 PM
yuhan closed D2336: #2320 add root_run_id to group related runs.
Fri, Mar 27, 8:08 PM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

up

Fri, Mar 27, 7:51 PM
yuhan added inline comments to D2336: #2320 add root_run_id to group related runs.
Fri, Mar 27, 7:50 PM
yuhan updated the summary of D2346: [doc] add GA to docs.dagster.io.
Fri, Mar 27, 6:27 AM
yuhan created D2346: [doc] add GA to docs.dagster.io.
Fri, Mar 27, 6:14 AM

Thu, Mar 26

yuhan added inline comments to D2336: #2320 add root_run_id to group related runs.
Thu, Mar 26, 11:00 PM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

add a comment

Thu, Mar 26, 10:57 PM
yuhan added inline comments to D2336: #2320 add root_run_id to group related runs.
Thu, Mar 26, 10:50 PM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

up

Thu, Mar 26, 10:47 PM
yuhan added inline comments to D2336: #2320 add root_run_id to group related runs.
Thu, Mar 26, 7:51 PM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

typo

Thu, Mar 26, 12:24 AM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

up

Thu, Mar 26, 12:18 AM
yuhan retitled D2336: #2320 add root_run_id to group related runs from #2320 add root_run_id (root run id) to group related runs to #2320 add root_run_id to group related runs.
Thu, Mar 26, 12:08 AM
yuhan retitled D2336: #2320 add root_run_id to group related runs from #2320 add run_grouping_id (root run id) to group related runs to #2320 add root_run_id (root run id) to group related runs.
Thu, Mar 26, 12:07 AM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

consolidate names of buttons using RunActionButtons

Thu, Mar 26, 12:05 AM

Wed, Mar 25

yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

refactor getExecutionVariables for Run and RunTable

Wed, Mar 25, 11:18 PM
yuhan committed R1:56d62dde12ca: #2188 convert local time to utc in PipelineRunStatsSnapshot (authored by yuhan).
#2188 convert local time to utc in PipelineRunStatsSnapshot
Wed, Mar 25, 7:34 PM
yuhan closed D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.
Wed, Mar 25, 7:34 PM
yuhan updated the diff for D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.

rebase master and run BK before land

Wed, Mar 25, 7:20 PM
yuhan updated the diff for D2336: #2320 add root_run_id to group related runs.

up

Wed, Mar 25, 6:18 AM
yuhan updated the summary of D2336: #2320 add root_run_id to group related runs.
Wed, Mar 25, 5:44 AM
yuhan created D2336: #2320 add root_run_id to group related runs.
Wed, Mar 25, 5:38 AM

Mon, Mar 23

yuhan added a comment to D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.

@sashank plz see the version tags in the runs. Both runs were started around 3:20PM PST, which is 22:20PM UTC)
with this change,

  • (version: master) the runs started before this change would not have correct timestamp
    • stored in storage as local
    • displayed in ui as localized local (which is messed up).
  • (version: diff w/ utc_datetime_from_timestamp) only the runs started after this change will have the correct timestamp
    • they are stored in storage as utc
    • displayed as local

Mon, Mar 23, 11:15 PM
yuhan committed R1:f29a3f735724: #2296 add dagster/parent_run_id tag when re-execution (authored by yuhan).
#2296 add dagster/parent_run_id tag when re-execution
Mon, Mar 23, 8:44 PM
yuhan closed D2322: #2296 add dagster/parent_run_id tag when re-execution.
Mon, Mar 23, 8:44 PM
yuhan updated the summary of D2322: #2296 add dagster/parent_run_id tag when re-execution.
Mon, Mar 23, 8:39 PM
yuhan added inline comments to D2322: #2296 add dagster/parent_run_id tag when re-execution.
Mon, Mar 23, 8:34 PM
yuhan updated the diff for D2322: #2296 add dagster/parent_run_id tag when re-execution.

update

Mon, Mar 23, 8:31 PM
yuhan updated the summary of D2322: #2296 add dagster/parent_run_id tag when re-execution.
Mon, Mar 23, 5:45 PM
yuhan created D2322: #2296 add dagster/parent_run_id tag when re-execution.
Mon, Mar 23, 5:36 PM

Sat, Mar 21

yuhan updated the diff for D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.

fix timezone at creation rather than parsing

Sat, Mar 21, 4:54 AM

Fri, Mar 20

yuhan updated the summary of D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.
Fri, Mar 20, 12:01 AM

Thu, Mar 19

yuhan created D2294: #2188 convert local time to utc in PipelineRunStatsSnapshot.
Thu, Mar 19, 11:57 PM
yuhan committed R1:4d510707fa9f: #1848 output_materialization_config should be able to yield arbitrarily many… (authored by yuhan).
#1848 output_materialization_config should be able to yield arbitrarily many…
Thu, Mar 19, 7:58 PM
yuhan closed D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Thu, Mar 19, 7:58 PM
yuhan updated the diff for D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.

rebase master

Thu, Mar 19, 6:31 PM
yuhan committed R1:314b29b249fe: fix intermediates re-execution in tutorial (authored by yuhan).
fix intermediates re-execution in tutorial
Thu, Mar 19, 5:03 AM
yuhan closed D2249: fix intermediates re-execution in tutorial.
Thu, Mar 19, 5:03 AM
yuhan updated the diff for D2249: fix intermediates re-execution in tutorial.

rebase master. no changes but just to run BK again to make sure it passes, because this diff is kinda behind

Thu, Mar 19, 1:32 AM
yuhan updated the summary of D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Thu, Mar 19, 1:13 AM
yuhan updated the summary of D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Thu, Mar 19, 1:11 AM

Tue, Mar 17

yuhan added a comment to D2250: Add Redshift resource.
In D2250#57526, @max wrote:

it might not be crazy just to have docs saying, you can do load/unload by running res.execute_query('COPY blah blah')

Tue, Mar 17, 8:34 PM
yuhan added inline comments to D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Tue, Mar 17, 6:54 AM
yuhan updated the diff for D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.

update

Tue, Mar 17, 3:12 AM
yuhan updated the diff for D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.

switch back to return Materialization for outputting single materialization. use ensure_gen to guard

Tue, Mar 17, 12:38 AM

Mon, Mar 16

yuhan updated the summary of D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Mon, Mar 16, 6:25 PM
yuhan updated the diff for D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.

There still will be one case broken in dagster-pandas.
Because I don't think @output_selector_schema should do yield multiple Materializations... So I will have to find a way to try-catch the "not a generator" error

Mon, Mar 16, 6:22 PM
yuhan updated the diff for D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.

update

Mon, Mar 16, 6:04 PM
yuhan created D2263: #1848 output_materialization_config should be able to yield arbitrarily many Materializations.
Mon, Mar 16, 7:19 AM

Fri, Mar 13

yuhan updated the diff for D2249: fix intermediates re-execution in tutorial.

fix isort

Fri, Mar 13, 10:37 PM
yuhan committed R1:e8e01c04a020: #2261 better Execution Plan error handling (authored by yuhan).
#2261 better Execution Plan error handling
Fri, Mar 13, 10:24 PM
yuhan closed D2241: #2261 better Execution Plan error handling.
Fri, Mar 13, 10:24 PM
yuhan added inline comments to D2249: fix intermediates re-execution in tutorial.
Fri, Mar 13, 10:18 PM
yuhan created D2249: fix intermediates re-execution in tutorial.
Fri, Mar 13, 10:17 PM
yuhan retitled D2241: #2261 better Execution Plan error handling from #2261 fix intermediates re-execution tutorial and better Execution Plan error handling to #2261 better Execution Plan error handling.
Fri, Mar 13, 10:05 PM
yuhan added inline comments to D2241: #2261 better Execution Plan error handling.
Fri, Mar 13, 9:33 PM
yuhan updated the diff for D2241: #2261 better Execution Plan error handling.

split this diff into two diffs. this current one is for dagster-graphql

Fri, Mar 13, 9:31 PM
yuhan updated the diff for D2241: #2261 better Execution Plan error handling.

update

Fri, Mar 13, 9:14 PM
yuhan added reviewers for D2241: #2261 better Execution Plan error handling: alangenfeld, max.
Fri, Mar 13, 6:04 PM