Page MenuHomePhabricator

catherinewu (Catherine)
UserAdministrator

Projects

User does not belong to any projects.

User Details

User Since
Feb 24 2020, 6:17 PM (6 w, 3 d)
Roles
Administrator

Recent Activity

Wed, Apr 8

catherinewu accepted D2482: Update buildkite queues.
Wed, Apr 8, 6:45 PM

Tue, Apr 7

catherinewu updated the diff for D2416: playing around with airflow -> dagster compilation.

copy dag structure, test with single + double + diamond dags

Tue, Apr 7, 6:24 AM

Mon, Apr 6

catherinewu updated the diff for D2416: playing around with airflow -> dagster compilation.

support solid dependencies

Mon, Apr 6, 5:27 AM

Fri, Apr 3

catherinewu committed R1:eee444af51f4: Add hello/email banner, add telemetry banner, add whitelisted function list to… (authored by catherinewu).
Add hello/email banner, add telemetry banner, add whitelisted function list to…
Fri, Apr 3, 5:48 PM
catherinewu closed D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
Fri, Apr 3, 5:48 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

fix import

Fri, Apr 3, 4:56 PM

Thu, Apr 2

catherinewu accepted D2418: Move dagster-airflow construct_variables to dagster-graphql.
Thu, Apr 2, 7:08 PM
catherinewu created D2416: playing around with airflow -> dagster compilation.
Thu, Apr 2, 4:45 PM

Tue, Mar 31

catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Tue, Mar 31, 11:25 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Tue, Mar 31, 11:22 PM
catherinewu committed R1:6851d7905b04: Move InvocationArgs to top level DagsterOperatorInvocationArgs (authored by catherinewu).
Move InvocationArgs to top level DagsterOperatorInvocationArgs
Tue, Mar 31, 11:01 PM
catherinewu closed D2394: Move InvocationArgs to top level DagsterOperatorInvocationArgs.
Tue, Mar 31, 11:01 PM
catherinewu added a reviewer for D2394: Move InvocationArgs to top level DagsterOperatorInvocationArgs: schrockn.
Tue, Mar 31, 10:57 PM
catherinewu created D2394: Move InvocationArgs to top level DagsterOperatorInvocationArgs.
Tue, Mar 31, 10:36 PM
catherinewu committed R1:5aef9529466d: Make _make_airflow_dag a public api (authored by catherinewu).
Make _make_airflow_dag a public api
Tue, Mar 31, 10:15 PM
catherinewu closed D2268: Make _make_airflow_dag a public api.
Tue, Mar 31, 10:15 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

rebase

Tue, Mar 31, 10:02 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 31, 9:42 PM

Fri, Mar 27

catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

:face_palm:

Fri, Mar 27, 4:56 AM

Thu, Mar 26

catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 11:47 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 11:26 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 11:11 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 10:28 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 10:11 PM
catherinewu added a comment to D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

verified that sys.stdout.isatty() and sys.stdin.isatty()are both false when run from within a docker container

Thu, Mar 26, 7:01 PM
catherinewu added a reviewer for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out: schrockn.

I'm not sure whether we should keep the add_email endpoint in the subdomain 'telemetry.dagster.io/'

Thu, Mar 26, 6:28 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Thu, Mar 26, 6:23 PM

Wed, Mar 25

catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Wed, Mar 25, 11:42 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Wed, Mar 25, 11:24 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Wed, Mar 25, 11:08 PM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Wed, Mar 25, 12:07 AM

Tue, Mar 24

catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 24, 10:57 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Tue, Mar 24, 10:05 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

check TTY before prompting user for email

Tue, Mar 24, 10:00 PM
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.

up

Tue, Mar 24, 8:20 AM
catherinewu created D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
Tue, Mar 24, 8:18 AM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 24, 4:43 AM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 24, 12:28 AM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 24, 12:25 AM

Fri, Mar 20

catherinewu committed R1:049d033ee340: Change telemetry to be opt-in instead (authored by catherinewu).
Change telemetry to be opt-in instead
Fri, Mar 20, 1:58 AM
catherinewu closed D2287: Change telemetry to be opt-in instead.
Fri, Mar 20, 1:58 AM
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

up

Fri, Mar 20, 1:30 AM
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

up

Fri, Mar 20, 1:28 AM
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

lint

Fri, Mar 20, 1:04 AM
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

add tests

Fri, Mar 20, 12:39 AM

Thu, Mar 19

catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

up

Thu, Mar 19, 10:23 PM
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.

remove programmatic editing for dagster.yaml, move instance_id to $DAGSTER_HOME/telemetry/id.yaml, tested manually. currently updating / adding to test suite

Thu, Mar 19, 10:18 PM

Wed, Mar 18

catherinewu added a reviewer for D2287: Change telemetry to be opt-in instead: alangenfeld.
Wed, Mar 18, 10:40 PM
catherinewu created D2287: Change telemetry to be opt-in instead.
Wed, Mar 18, 10:39 PM
catherinewu added inline comments to D2283: Fix https://dagster.phacility.com/P39.
Wed, Mar 18, 10:35 PM
catherinewu committed R1:03e78c739853: Fix https://dagster.phacility.com/P39 (authored by catherinewu).
Fix https://dagster.phacility.com/P39
Wed, Mar 18, 10:09 PM
catherinewu closed D2283: Fix https://dagster.phacility.com/P39.
Wed, Mar 18, 10:09 PM
catherinewu updated the diff for D2283: Fix https://dagster.phacility.com/P39.

fix test

Wed, Mar 18, 9:54 PM
catherinewu added a reviewer for D2283: Fix https://dagster.phacility.com/P39: alangenfeld.
Wed, Mar 18, 8:35 PM
catherinewu updated the diff for D2283: Fix https://dagster.phacility.com/P39.

up

Wed, Mar 18, 8:34 PM
catherinewu updated the summary of D2283: Fix https://dagster.phacility.com/P39.
Wed, Mar 18, 8:33 PM
catherinewu created D2283: Fix https://dagster.phacility.com/P39.
Wed, Mar 18, 8:32 PM
catherinewu committed R1:832cbe9e0af3: Initial pass at telemetry (authored by catherinewu).
Initial pass at telemetry
Wed, Mar 18, 6:21 AM
catherinewu closed D2233: Initial pass at telemetry.
Wed, Mar 18, 6:20 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

rebase

Wed, Mar 18, 5:35 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Wed, Mar 18, 5:11 AM
catherinewu accepted D2276: Small fix for Helm chart.
Wed, Mar 18, 3:23 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Wed, Mar 18, 12:44 AM
catherinewu added a comment to D2233: Initial pass at telemetry.

adding a note that uplaoding on dagster pipeline run is a bit more complicated to support because

  1. we would need a locking mechanism in case dagit and dagster cli are trying to upload simultaneously
  2. dagster cli processes will tend to be more short lived
Wed, Mar 18, 12:40 AM

Tue, Mar 17

catherinewu updated the diff for D2233: Initial pass at telemetry.

fix test, add event id

Tue, Mar 17, 8:58 PM
catherinewu added inline comments to D2233: Initial pass at telemetry.
Tue, Mar 17, 8:23 PM
catherinewu committed R1:08b6d34249c2: Add open source promise to docs (authored by catherinewu).
Add open source promise to docs
Tue, Mar 17, 7:56 PM
catherinewu closed D2236: Add open source promise to docs.
Tue, Mar 17, 7:56 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Tue, Mar 17, 7:55 PM
catherinewu added a reviewer for D2268: Make _make_airflow_dag a public api: schrockn.

hmm, is this what you had in mind?

Tue, Mar 17, 3:40 AM
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.

up

Tue, Mar 17, 3:31 AM
catherinewu created D2268: Make _make_airflow_dag a public api.
Tue, Mar 17, 3:23 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

fix test

Tue, Mar 17, 1:01 AM
catherinewu updated the diff for D2236: Add open source promise to docs.

update

Tue, Mar 17, 12:27 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Tue, Mar 17, 12:07 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

send log file every hour or when logs > 10MB, send log file directly (without parsing), use two files to improve robustness (log.txt and log-queue.txt)

Tue, Mar 17, 12:02 AM

Mon, Mar 16

catherinewu added inline comments to D2233: Initial pass at telemetry.
Mon, Mar 16, 6:59 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

comments

Mon, Mar 16, 6:58 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

update endpoint

Mon, Mar 16, 6:29 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

oops, add month/day/year back into logs

Mon, Mar 16, 5:50 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

write logs to $DAGSTER_HOME/log.txt instead of POST-ing immediately, update tests, add threading to handle file upload async when dagit is started up (with 3 retries), add redirect from telemetry.dagster.io => telemetry.elementl.dev, TODO: add more testing

Mon, Mar 16, 5:27 PM
catherinewu added inline comments to D2236: Add open source promise to docs.
Mon, Mar 16, 4:42 PM

Sat, Mar 14

catherinewu updated the diff for D2233: Initial pass at telemetry.

revert async stuff

Sat, Mar 14, 1:43 AM

Fri, Mar 13

catherinewu updated the diff for D2233: Initial pass at telemetry.

async request, cli

Fri, Mar 13, 8:31 PM
catherinewu added inline comments to D2233: Initial pass at telemetry.
Fri, Mar 13, 8:17 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Fri, Mar 13, 8:06 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

up

Fri, Mar 13, 8:03 AM
catherinewu added inline comments to D2233: Initial pass at telemetry.
Fri, Mar 13, 7:04 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

comments

Fri, Mar 13, 6:56 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

address half of comments

Fri, Mar 13, 5:21 AM

Thu, Mar 12

catherinewu updated the diff for D2233: Initial pass at telemetry.

fix tests

Thu, Mar 12, 5:25 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

remove history/ schedules/ storage/

Thu, Mar 12, 5:23 PM
catherinewu updated the diff for D2233: Initial pass at telemetry.

disable telemetry in non-telemetry tests

Thu, Mar 12, 4:02 AM
catherinewu updated the summary of D2233: Initial pass at telemetry.
Thu, Mar 12, 2:24 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

clean up

Thu, Mar 12, 1:50 AM
catherinewu added reviewers for D2233: Initial pass at telemetry: max, sashank, nate.
Thu, Mar 12, 1:47 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

Add print-related helper functions to seven

Thu, Mar 12, 1:43 AM
catherinewu updated the diff for D2233: Initial pass at telemetry.

fix tests

Thu, Mar 12, 12:55 AM

Wed, Mar 11

catherinewu updated the diff for D2233: Initial pass at telemetry.

fix tests

Wed, Mar 11, 10:36 PM
catherinewu added a comment to D2236: Add open source promise to docs.

Wed, Mar 11, 10:16 PM