User Details
User Details
- User Since
- Feb 24 2020, 6:17 PM (6 w, 3 d)
- Roles
- Administrator
Wed, Apr 8
Wed, Apr 8
Tue, Apr 7
Tue, Apr 7
catherinewu updated the diff for D2416: playing around with airflow -> dagster compilation.
copy dag structure, test with single + double + diamond dags
Mon, Apr 6
Mon, Apr 6
catherinewu updated the diff for D2416: playing around with airflow -> dagster compilation.
support solid dependencies
Fri, Apr 3
Fri, Apr 3
catherinewu committed R1:eee444af51f4: Add hello/email banner, add telemetry banner, add whitelisted function list to… (authored by catherinewu).
Add hello/email banner, add telemetry banner, add whitelisted function list to…
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
fix import
Thu, Apr 2
Thu, Apr 2
Tue, Mar 31
Tue, Mar 31
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
catherinewu committed R1:6851d7905b04: Move InvocationArgs to top level DagsterOperatorInvocationArgs (authored by catherinewu).
Move InvocationArgs to top level DagsterOperatorInvocationArgs
catherinewu added a reviewer for D2394: Move InvocationArgs to top level DagsterOperatorInvocationArgs: schrockn.
catherinewu committed R1:5aef9529466d: Make _make_airflow_dag a public api (authored by catherinewu).
Make _make_airflow_dag a public api
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.
rebase
Fri, Mar 27
Fri, Mar 27
catherinewu updated the diff for D2268: Make _make_airflow_dag a public api.
:face_palm:
Thu, Mar 26
Thu, Mar 26
catherinewu added a comment to D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
verified that sys.stdout.isatty() and sys.stdin.isatty()are both false when run from within a docker container
catherinewu added a reviewer for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out: schrockn.
I'm not sure whether we should keep the add_email endpoint in the subdomain 'telemetry.dagster.io/'
Wed, Mar 25
Wed, Mar 25
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
Tue, Mar 24
Tue, Mar 24
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
check TTY before prompting user for email
catherinewu updated the diff for D2324: Add hello/email banner, add telemetry banner, add whitelisted function list to code + docs, make telemetry opt-out.
up
Fri, Mar 20
Fri, Mar 20
catherinewu committed R1:049d033ee340: Change telemetry to be opt-in instead (authored by catherinewu).
Change telemetry to be opt-in instead
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
up
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
up
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
lint
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
add tests
Thu, Mar 19
Thu, Mar 19
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
up
catherinewu updated the diff for D2287: Change telemetry to be opt-in instead.
remove programmatic editing for dagster.yaml, move instance_id to $DAGSTER_HOME/telemetry/id.yaml, tested manually. currently updating / adding to test suite
Wed, Mar 18
Wed, Mar 18
catherinewu added inline comments to D2283: Fix https://dagster.phacility.com/P39.
catherinewu committed R1:03e78c739853: Fix https://dagster.phacility.com/P39 (authored by catherinewu).
Fix https://dagster.phacility.com/P39
catherinewu updated the diff for D2283: Fix https://dagster.phacility.com/P39.
fix test
catherinewu updated the diff for D2283: Fix https://dagster.phacility.com/P39.
up
catherinewu updated the summary of D2283: Fix https://dagster.phacility.com/P39.
Initial pass at telemetry
catherinewu added a comment to D2233: Initial pass at telemetry.
adding a note that uplaoding on dagster pipeline run is a bit more complicated to support because
- we would need a locking mechanism in case dagit and dagster cli are trying to upload simultaneously
- dagster cli processes will tend to be more short lived
Tue, Mar 17
Tue, Mar 17
catherinewu updated the diff for D2233: Initial pass at telemetry.
fix test, add event id
catherinewu added inline comments to D2233: Initial pass at telemetry.
Add open source promise to docs
hmm, is this what you had in mind?
catherinewu updated the diff for D2233: Initial pass at telemetry.
send log file every hour or when logs > 10MB, send log file directly (without parsing), use two files to improve robustness (log.txt and log-queue.txt)
Mon, Mar 16
Mon, Mar 16
catherinewu added inline comments to D2233: Initial pass at telemetry.
catherinewu updated the diff for D2233: Initial pass at telemetry.
update endpoint
catherinewu updated the diff for D2233: Initial pass at telemetry.
oops, add month/day/year back into logs
catherinewu updated the diff for D2233: Initial pass at telemetry.
write logs to $DAGSTER_HOME/log.txt instead of POST-ing immediately, update tests, add threading to handle file upload async when dagit is started up (with 3 retries), add redirect from telemetry.dagster.io => telemetry.elementl.dev, TODO: add more testing
catherinewu added inline comments to D2236: Add open source promise to docs.
Sat, Mar 14
Sat, Mar 14
catherinewu updated the diff for D2233: Initial pass at telemetry.
revert async stuff
Fri, Mar 13
Fri, Mar 13
catherinewu updated the diff for D2233: Initial pass at telemetry.
async request, cli
catherinewu added inline comments to D2233: Initial pass at telemetry.
catherinewu added inline comments to D2233: Initial pass at telemetry.
catherinewu updated the diff for D2233: Initial pass at telemetry.
address half of comments
Thu, Mar 12
Thu, Mar 12
catherinewu updated the diff for D2233: Initial pass at telemetry.
remove history/ schedules/ storage/
catherinewu updated the diff for D2233: Initial pass at telemetry.
disable telemetry in non-telemetry tests
catherinewu updated the summary of D2233: Initial pass at telemetry.
catherinewu updated the diff for D2233: Initial pass at telemetry.
Add print-related helper functions to seven
Wed, Mar 11
Wed, Mar 11
