Page MenuHomePhabricator

nate (Nate Kupp)
UserAdministrator

Projects

User does not belong to any projects.

User Details

User Since
Apr 23 2019, 10:22 PM (50 w, 10 h)
Roles
Administrator

Recent Activity

Today

nate accepted D2471: Fix tests for intro tutorial.
Wed, Apr 8, 3:20 AM
nate accepted D2462: [docs] Move docs file conversion to process script.
Wed, Apr 8, 3:11 AM

Yesterday

nate committed R1:ffa9f9edb885: Document use of bash solids (#2345) (authored by nate).
Document use of bash solids (#2345)
Tue, Apr 7, 11:48 PM
nate closed D2468: Document use of bash solids (#2345).
Tue, Apr 7, 11:48 PM
nate updated the diff for D2468: Document use of bash solids (#2345).

use safe_tempfile_path

Tue, Apr 7, 11:35 PM
nate updated the diff for D2468: Document use of bash solids (#2345).

Adding Apache license for code derived from Airflow

Tue, Apr 7, 11:28 PM
nate added reviewers for D2468: Document use of bash solids (#2345): max, sandyryza.
Tue, Apr 7, 10:56 PM
nate added inline comments to D2468: Document use of bash solids (#2345).
Tue, Apr 7, 10:55 PM
nate updated the diff for D2468: Document use of bash solids (#2345).

py2

Tue, Apr 7, 10:51 PM
nate updated the summary of D2468: Document use of bash solids (#2345).
Tue, Apr 7, 10:47 PM
nate updated the diff for D2468: Document use of bash solids (#2345).

up

Tue, Apr 7, 10:45 PM
nate created D2468: Document use of bash solids (#2345).
Tue, Apr 7, 10:44 PM

Mon, Apr 6

nate committed R1:9079c2140bb1: Move over the rest of examples presets to from_pkg_resources (authored by nate).
Move over the rest of examples presets to from_pkg_resources
Mon, Apr 6, 9:31 PM
nate closed D2456: Move over the rest of examples presets to from_pkg_resources.
Mon, Apr 6, 9:31 PM
nate added a comment to D2456: Move over the rest of examples presets to from_pkg_resources.

yep, manually verified. thanks!

Mon, Apr 6, 9:31 PM
nate requested review of D2456: Move over the rest of examples presets to from_pkg_resources.

ok, I don't think we have any explicit reference to PresetDefinition.from_files in the docs

Mon, Apr 6, 7:48 PM
nate planned changes to D2456: Move over the rest of examples presets to from_pkg_resources.

let me check the docs also

Mon, Apr 6, 7:46 PM
nate added reviewers for D2456: Move over the rest of examples presets to from_pkg_resources: max, themissinghlink.
Mon, Apr 6, 7:45 PM
nate updated the diff for D2456: Move over the rest of examples presets to from_pkg_resources.

up

Mon, Apr 6, 7:35 PM
nate created D2456: Move over the rest of examples presets to from_pkg_resources.
Mon, Apr 6, 7:26 PM
nate accepted D2453: gitignore output of intro_tutorial.
Mon, Apr 6, 6:16 PM
nate committed R1:f57218b7caf4: Update preset defs loading in bay bikes (authored by nate).
Update preset defs loading in bay bikes
Mon, Apr 6, 6:14 PM
nate closed D2450: Update preset defs loading in bay bikes.
Mon, Apr 6, 6:14 PM
nate retitled D2450: Update preset defs loading in bay bikes from Update preset defs loading to Update preset defs loading in bay bikes.
Mon, Apr 6, 5:34 PM
nate updated the diff for D2450: Update preset defs loading in bay bikes.

up

Mon, Apr 6, 4:31 PM
nate updated the diff for D2450: Update preset defs loading in bay bikes.

up

Mon, Apr 6, 2:57 PM
nate created D2450: Update preset defs loading in bay bikes.
Mon, Apr 6, 2:49 PM
nate committed R1:c9d5e2c6179f: Add PresetDefinition.from_pkg_resources (authored by nate).
Add PresetDefinition.from_pkg_resources
Mon, Apr 6, 1:55 PM
nate closed D2443: Add PresetDefinition.from_pkg_resources.
Mon, Apr 6, 1:55 PM
nate added inline comments to D2443: Add PresetDefinition.from_pkg_resources.
Mon, Apr 6, 1:55 PM

Sun, Apr 5

nate planned changes to D2334: [dagster-aws] EMR pyspark deploy modes.
Sun, Apr 5, 6:19 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

py2

Sun, Apr 5, 5:50 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sun, Apr 5, 5:21 PM
nate added a comment to D2443: Add PresetDefinition.from_pkg_resources.

Cool, thank you for taking a close look! Updated to address comments.

Sun, Apr 5, 5:21 PM

Sat, Apr 4

nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 8:41 PM
nate added reviewers for D2443: Add PresetDefinition.from_pkg_resources: sashank, prha, max.
Sat, Apr 4, 8:39 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 8:20 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 8:11 PM
nate retitled D2443: Add PresetDefinition.from_pkg_resources from Add PresetDefinition.from_yaml_strings to Add PresetDefinition.from_pkg_resources.
Sat, Apr 4, 8:10 PM
nate updated the summary of D2443: Add PresetDefinition.from_pkg_resources.
Sat, Apr 4, 8:03 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 8:01 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 7:10 PM
nate updated the diff for D2443: Add PresetDefinition.from_pkg_resources.

up

Sat, Apr 4, 7:03 PM
nate updated the summary of D2443: Add PresetDefinition.from_pkg_resources.
Sat, Apr 4, 6:42 PM
nate updated the summary of D2443: Add PresetDefinition.from_pkg_resources.
Sat, Apr 4, 6:42 PM
nate created D2443: Add PresetDefinition.from_pkg_resources.
Sat, Apr 4, 6:37 PM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

up

Sat, Apr 4, 5:35 AM

Fri, Apr 3

nate accepted D2436: #2200 Use StringSource in spark configs.
Fri, Apr 3, 9:26 PM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

experiment with graphql query instead of execute_solid_within_pipeline()

Fri, Apr 3, 4:54 AM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

up

Fri, Apr 3, 3:21 AM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

rebase

Fri, Apr 3, 3:09 AM
nate committed R1:3b1f803bd14b: Remove solid name argument and add test for aliased pyspark_solid (authored by nate).
Remove solid name argument and add test for aliased pyspark_solid
Fri, Apr 3, 3:04 AM
nate closed D2428: Remove solid name argument and add test for aliased pyspark_solid.
Fri, Apr 3, 3:04 AM
nate committed R1:bfd3d8685aa4: Update AWS imports (authored by nate).
Update AWS imports
Fri, Apr 3, 3:00 AM
nate closed D2429: Update AWS imports.
Fri, Apr 3, 3:00 AM
nate added a reviewer for D2428: Remove solid name argument and add test for aliased pyspark_solid: themissinghlink.
Fri, Apr 3, 2:58 AM
nate updated the summary of D2429: Update AWS imports.
Fri, Apr 3, 2:49 AM
nate updated the diff for D2428: Remove solid name argument and add test for aliased pyspark_solid.

up

Fri, Apr 3, 2:49 AM
nate created D2429: Update AWS imports.
Fri, Apr 3, 2:47 AM
nate created D2428: Remove solid name argument and add test for aliased pyspark_solid.
Fri, Apr 3, 2:44 AM
nate committed R1:bdf35b60fa0f: Move keras imports (authored by nate).
Move keras imports
Fri, Apr 3, 2:36 AM
nate closed D2427: Move keras imports.
Fri, Apr 3, 2:36 AM
nate updated the summary of D2427: Move keras imports.
Fri, Apr 3, 2:31 AM
nate added reviewers for D2427: Move keras imports: max, themissinghlink.
Fri, Apr 3, 2:31 AM

Thu, Apr 2

nate created D2427: Move keras imports.
Thu, Apr 2, 11:37 PM
nate added a comment to D2424: add utility script to clean resolved phabricator git tags.

Thanks for doing this! Looks reasonable enough to me. Do you want to update Buildkite also to run bin/clean.py on every merge to master?

Thu, Apr 2, 10:55 PM
nate accepted D2422: Correctly escape quote characters in config over the dagstermill bridge.

looks reasonable to me!

Thu, Apr 2, 10:17 PM
nate created D2423: Spark refresh.
Thu, Apr 2, 10:12 PM
nate planned changes to D2409: RFC: DinD + Celery.
Thu, Apr 2, 9:57 PM
nate abandoned D1745: [EMR 3/N] Spark refresh.
Thu, Apr 2, 9:50 PM
nate updated the diff for D2409: RFC: DinD + Celery.

up

Thu, Apr 2, 9:29 PM
nate accepted D2419: [celery] mention url encoding passwords.
Thu, Apr 2, 9:11 PM
nate committed R1:abfa399da70a: Move dagster-airflow construct_variables to dagster-graphql (authored by nate).
Move dagster-airflow construct_variables to dagster-graphql
Thu, Apr 2, 7:59 PM
nate closed D2418: Move dagster-airflow construct_variables to dagster-graphql.
Thu, Apr 2, 7:59 PM
nate updated the diff for D2418: Move dagster-airflow construct_variables to dagster-graphql.

up

Thu, Apr 2, 7:31 PM
nate planned changes to D2409: RFC: DinD + Celery.
Thu, Apr 2, 6:14 PM
nate planned changes to D2334: [dagster-aws] EMR pyspark deploy modes.
Thu, Apr 2, 6:07 PM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

up

Thu, Apr 2, 6:07 PM
nate updated the summary of D2418: Move dagster-airflow construct_variables to dagster-graphql.
Thu, Apr 2, 5:40 PM
nate updated the diff for D2418: Move dagster-airflow construct_variables to dagster-graphql.

up

Thu, Apr 2, 5:37 PM
nate created D2418: Move dagster-airflow construct_variables to dagster-graphql.
Thu, Apr 2, 5:35 PM
nate updated the diff for D2409: RFC: DinD + Celery.

up

Thu, Apr 2, 5:23 PM
nate accepted D2414: unpin grpcio in examples..
Thu, Apr 2, 4:08 PM
nate updated the diff for D2409: RFC: DinD + Celery.

up

Thu, Apr 2, 12:47 AM
nate added a comment to D2410: (refactor-validation-context-1) Rename ValidationContext to TraversalContext.

The Wheel of Time turns, and Ages come and pass, leaving memories that become legend. Legend fades to myth, and even myth is long forgotten when the Age that gave it birth comes again

Thu, Apr 2, 12:15 AM

Wed, Apr 1

nate created D2409: RFC: DinD + Celery.
Wed, Apr 1, 11:57 PM
nate accepted D2381: (1-read-only-containers)-container-snapshot-provider-scaffolding.
Wed, Apr 1, 8:51 PM
nate committed R1:bd8c904bb212: Update default celery queue in k8s (authored by nate).
Update default celery queue in k8s
Wed, Apr 1, 8:45 PM
nate closed D2401: Update default celery queue in k8s.
Wed, Apr 1, 8:45 PM
nate added a comment to D2401: Update default celery queue in k8s.

This wasn't working before, because we were servicing the "default" queue by default; but dagster-celery uses "dagster" by default https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-celery/dagster_celery/defaults.py#L13

Wed, Apr 1, 7:03 PM
nate added a comment to D2381: (1-read-only-containers)-container-snapshot-provider-scaffolding.

I think the repository.yaml constraint is reasonable, but maybe we can relax the requirement for the entrypoint being set? I think in our other images we haven't set this, that way the end user can choose to run dagster, dagster-graphql, dagit, etc. on the same image depending on use case

Wed, Apr 1, 4:49 PM
nate accepted D2402: Ignore unmatched partitions in schedule view.
Wed, Apr 1, 2:53 PM
nate created D2401: Update default celery queue in k8s.
Wed, Apr 1, 4:57 AM
nate added inline comments to D2381: (1-read-only-containers)-container-snapshot-provider-scaffolding.
Wed, Apr 1, 3:36 AM
nate added a comment to D2339: InputDefinition.default_value.

this is super nice and clean

Wed, Apr 1, 3:28 AM
nate committed R1:3c6ca147c835: Fix docs issue (authored by nate).
Fix docs issue
Wed, Apr 1, 1:30 AM
nate closed D2398: Fix docs issue.
Wed, Apr 1, 1:30 AM

Tue, Mar 31

nate created D2398: Fix docs issue.
Tue, Mar 31, 11:14 PM
nate planned changes to D2334: [dagster-aws] EMR pyspark deploy modes.

marking planned changes again—going to continue chipping away at this, but wanted to get WIP off my laptop

Tue, Mar 31, 6:59 PM
nate updated the diff for D2334: [dagster-aws] EMR pyspark deploy modes.

up

Tue, Mar 31, 6:57 PM