Page MenuHomePhabricator

Open Tasks

  • No tasks found.

Recent Activity

Today

alangenfeld accepted D1413: Provide example of type tests.

goforit

Thu, Nov 14, 7:09 PM
alangenfeld updated subscribers of D1349: pyspark on EMR.

@themissinghlink have you worked with pyspark much? Do you have thoughts here?

Thu, Nov 14, 7:07 PM
alangenfeld added a comment to D1349: pyspark on EMR.

Nice, this reminds me of some of the lakehouse stuff - I sense a pattern will continue emerging around these higher-level solid/resource relationship setups.

Thu, Nov 14, 7:07 PM
alangenfeld requested changes to D1370: RFC: chain function for building strings of solids.

I think a context manager that alters the composition context that:

  • ensures the first invocation is fully resolved and has a single output
  • ensures that subsequent invocations have a single unspecified input and single output
  • wires everything together
Thu, Nov 14, 6:58 PM
alangenfeld accepted D1419: Docs improvements.

yaytests

Thu, Nov 14, 6:33 PM
alangenfeld added a comment to D1425: Kitchen sink tutorial pipeline.

do we want to dupe all of this as opposed to import it from the other files? I worry about desync

Thu, Nov 14, 6:27 PM
prha added a reverting change for D1414: pin google-cloud-storage until they fix deps: R1:a8f1ce23c07e: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:48 PM
prha added a reverting change for R1:e42caa59efea: pin google-cloud-storage until they fix deps: R1:a8f1ce23c07e: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:48 PM
prha committed R1:a8f1ce23c07e: Revert "pin google-cloud-storage until they fix deps" (authored by prha).
Revert "pin google-cloud-storage until they fix deps"
Thu, Nov 14, 5:48 PM
prha closed D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:48 PM
natekupp accepted D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:43 PM
prha updated the summary of D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:41 AM
prha added a reverting change for D1414: pin google-cloud-storage until they fix deps: D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:28 AM
prha created D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:28 AM
prha added a reverting change for R1:e42caa59efea: pin google-cloud-storage until they fix deps: D1426: Revert "pin google-cloud-storage until they fix deps".
Thu, Nov 14, 5:28 AM
schrockn resigned from D1421: remove k8 operator.

Will let @natekupp pass the sentence to swing the sword on this one

Thu, Nov 14, 2:23 AM
Harbormaster failed remote builds in B5272: Diff 6550 for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource!
Thu, Nov 14, 2:22 AM
themissinghlink updated the diff for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.
  • fixed linter bug
Thu, Nov 14, 2:15 AM
themissinghlink updated the diff for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.
  • redesigned abstract bucket resource to transformaer resource to more cleanly match the semantics of what it was doing
Thu, Nov 14, 2:15 AM
Harbormaster failed remote builds in B5271: Diff 6549 for D1425: Kitchen sink tutorial pipeline!
Thu, Nov 14, 1:47 AM
max created D1425: Kitchen sink tutorial pipeline.
Thu, Nov 14, 1:40 AM
schrockn committed R1:e32cb41e31fa: Make pandas_hello_world a diamond (authored by schrockn).
Make pandas_hello_world a diamond
Thu, Nov 14, 1:13 AM
schrockn closed D1424: Make pandas_hello_world a diamond.
Thu, Nov 14, 1:13 AM
prha accepted D1424: Make pandas_hello_world a diamond.

whynot

Thu, Nov 14, 1:12 AM
schrockn created D1424: Make pandas_hello_world a diamond.
Thu, Nov 14, 12:58 AM
prha created D1423: test windows build.
Thu, Nov 14, 12:56 AM
themissinghlink added inline comments to D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.
Thu, Nov 14, 12:35 AM
max accepted D1416: [instance] support overrides.
Thu, Nov 14, 12:14 AM
max accepted D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.

not sure about this bucket api, please see comments. why not set_object(key, obj) and get_object(key)? maybe there's a missing upload_file api -- rn there's this odd asymmetry where we have set_object: str -> None and get_object: str -> blob (rather than set_object taking a blob and get_object giving one back)

Thu, Nov 14, 12:07 AM
prha closed D1355: Support run retry.
Thu, Nov 14, 12:04 AM
prha committed R1:875357b3a7a3: Support run retry (authored by prha).
Support run retry
Thu, Nov 14, 12:04 AM

Yesterday

max resigned from D1421: remove k8 operator.

I believe this is the right course of action until we get this under some form of test, will resign to @natekupp

Wed, Nov 13, 11:57 PM
max committed R1:d4af5d303d0e: Fixes a nasty nondeterministic bug in preset construction from source files (authored by max).
Fixes a nasty nondeterministic bug in preset construction from source files
Wed, Nov 13, 11:56 PM
Max Gasner <max.gasner@gmail.com> closed D1420: Fixes a nasty nondeterministic bug in preset construction from source files.
Wed, Nov 13, 11:56 PM
themissinghlink updated the diff for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.

up

Wed, Nov 13, 11:45 PM
Harbormaster failed remote builds in B5267: Diff 6542 for D1422: [exploration] execution server!
Wed, Nov 13, 11:25 PM
Harbormaster failed remote builds in B5262: Diff 6536 for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource!
Wed, Nov 13, 11:11 PM
Harbormaster failed remote builds in B5266: Diff 6541 for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource!
Wed, Nov 13, 11:03 PM
alangenfeld created D1422: [exploration] execution server.
Wed, Nov 13, 10:50 PM
themissinghlink updated the diff for D1396: Consolidate bay bike csv files into one csv file and upload to bucket resource.

up

Wed, Nov 13, 10:48 PM