Page MenuHomePhabricator
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Today

nate added a comment to D1649: Rewrite of the Composite Config Mapping and Parsing Stack.

per our conversation, love the direction, this is a massive improvement.

Sat, Dec 14, 1:25 AM
nate added inline comments to D1649: Rewrite of the Composite Config Mapping and Parsing Stack.
Sat, Dec 14, 12:32 AM

Yesterday

nate added a comment to D1650: [RFC] drop pyyaml reqs.

it would be really nice to be able to shade dependencies in Python.... https://github.com/sbt/sbt-assembly#shading

Fri, Dec 13, 10:09 PM
nate accepted D1650: [RFC] drop pyyaml reqs.

you can remove the constraint, but it's worth considering that our end users will likely have docker-compose installed and so they'll have pyyaml in that range, exciting these same bugs. It's becoming a big problem: https://github.com/docker/compose/issues/6619 - I'm not sure there are any good solutions here

Fri, Dec 13, 10:05 PM
nate updated the diff for D1645: Add support for GCS custom prefix.

retrigger build (pg failure)

Fri, Dec 13, 6:51 PM
nate accepted D1653: Bring versions into lockstep.
Fri, Dec 13, 6:49 PM
nate updated the diff for D1645: Add support for GCS custom prefix.

up

Fri, Dec 13, 6:39 PM
nate added a comment to D1645: Add support for GCS custom prefix.

whoops, I missed that in my copy-paste - thanks for catching. I added the config to system storage and also added tests for configuring both GCS and S3 storage prefix for pipeline execution.

Fri, Dec 13, 6:28 PM
nate updated the diff for D1645: Add support for GCS custom prefix.

up

Fri, Dec 13, 6:27 PM
nate accepted D1642: buildkite pre-exit hook.
Fri, Dec 13, 5:37 AM
nate accepted D1647: Figured images weren't big enough.
Fri, Dec 13, 1:05 AM

Thu, Dec 12

nate added reviewers for D1645: Add support for GCS custom prefix: max, sashank.
Thu, Dec 12, 9:00 PM
nate updated the diff for D1645: Add support for GCS custom prefix.

up

Thu, Dec 12, 8:43 PM
nate created D1645: Add support for GCS custom prefix.
Thu, Dec 12, 8:40 PM
nate updated the summary of D1641: Install AWS/GCP CLIs in integration image.
Thu, Dec 12, 7:02 PM
nate updated the diff for D1641: Install AWS/GCP CLIs in integration image.

up

Thu, Dec 12, 6:50 PM
nate added reviewers for D1643: Address issue with pyspark context (#1980): alangenfeld, max, schrockn.
Thu, Dec 12, 6:48 PM
nate updated the summary of D1643: Address issue with pyspark context (#1980).
Thu, Dec 12, 6:47 PM
nate updated the summary of D1643: Address issue with pyspark context (#1980).
Thu, Dec 12, 6:44 PM
nate created D1643: Address issue with pyspark context (#1980).
Thu, Dec 12, 6:37 PM
nate updated the diff for D1641: Install AWS/GCP CLIs in integration image.

up

Thu, Dec 12, 6:22 PM
nate updated the diff for D1641: Install AWS/GCP CLIs in integration image.

up

Thu, Dec 12, 6:02 PM
nate accepted D1642: buildkite pre-exit hook.

do you want to remove the docker-compose stop / rm -f calls from the pipeline.py file also?

Thu, Dec 12, 5:39 PM
nate updated the diff for D1641: Install AWS/GCP CLIs in integration image.

up

Thu, Dec 12, 5:34 PM
nate updated the diff for D1641: Install AWS/GCP CLIs in integration image.

up

Thu, Dec 12, 5:32 PM
nate created D1641: Install AWS/GCP CLIs in integration image.
Thu, Dec 12, 5:09 PM
nate accepted D1639: (config-parsing-decomp-1) Eliminate unused seen_handles argument on evaluate_config.
Thu, Dec 12, 4:55 PM
nate added reviewers for D1632: Add integration image build pipeline: alangenfeld, max.
Thu, Dec 12, 12:47 AM
nate updated the summary of D1632: Add integration image build pipeline.
Thu, Dec 12, 12:47 AM
nate updated the diff for D1632: Add integration image build pipeline.

rebase

Thu, Dec 12, 12:33 AM
nate updated the diff for D1632: Add integration image build pipeline.

up

Thu, Dec 12, 12:32 AM
nate updated the diff for D1632: Add integration image build pipeline.

up

Thu, Dec 12, 12:26 AM
nate added a reviewer for D1638: Make examples pip continue on failure: themissinghlink.
Thu, Dec 12, 12:17 AM
nate created D1638: Make examples pip continue on failure.
Thu, Dec 12, 12:16 AM

Wed, Dec 11

nate added a reviewer for D1637: different twine version: alangenfeld.
Wed, Dec 11, 11:50 PM
nate created D1637: different twine version.
Wed, Dec 11, 11:48 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 11:36 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 11:18 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 11:10 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 10:50 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 9:57 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 9:53 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 9:35 PM
nate abandoned D1608: [dagster-airflow] Skip when transient failures occur for now.
Wed, Dec 11, 8:01 PM
nate accepted D1633: Use new images.
Wed, Dec 11, 7:04 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 7:04 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 6:56 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 6:45 PM
nate updated the diff for D1632: Add integration image build pipeline.

up

Wed, Dec 11, 6:36 PM
nate created D1632: Add integration image build pipeline.
Wed, Dec 11, 6:23 PM
nate updated the test plan for D1631: Fix nightly build failure.
Wed, Dec 11, 3:03 PM
nate created D1631: Fix nightly build failure.
Wed, Dec 11, 3:01 PM
nate added inline comments to D1522: [EMR 2/N] Refresh Spark solid.
Wed, Dec 11, 12:21 AM
nate updated the diff for D1522: [EMR 2/N] Refresh Spark solid.

up

Wed, Dec 11, 12:11 AM
nate updated the diff for D1522: [EMR 2/N] Refresh Spark solid.

rebase

Wed, Dec 11, 12:01 AM

Tue, Dec 10

nate updated the diff for D1521: [EMR 1/N] Extract EMR implementation.

up

Tue, Dec 10, 11:45 PM
nate updated the diff for D1521: [EMR 1/N] Extract EMR implementation.

rebase/comment

Tue, Dec 10, 11:38 PM
nate added inline comments to D1521: [EMR 1/N] Extract EMR implementation.
Tue, Dec 10, 11:38 PM
nate updated the summary of D1629: Refresh the deployment documentation.
Tue, Dec 10, 11:20 PM
nate created D1629: Refresh the deployment documentation.
Tue, Dec 10, 11:08 PM
nate added inline comments to D1624: Clean up requirements/build dependencies.
Tue, Dec 10, 6:51 PM
nate added a reviewer for D1624: Clean up requirements/build dependencies: schrockn.
Tue, Dec 10, 6:43 PM
nate updated the summary of D1624: Clean up requirements/build dependencies.
Tue, Dec 10, 6:37 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:33 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:25 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:23 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:18 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:15 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:09 PM
nate updated the diff for D1624: Clean up requirements/build dependencies.

up

Tue, Dec 10, 6:07 PM
nate created D1624: Clean up requirements/build dependencies.
Tue, Dec 10, 6:01 PM

Mon, Dec 9

nate accepted D1607: fix config mapping bug.

ugh - thanks for fixing and the tests

Mon, Dec 9, 10:16 PM
nate created D1608: [dagster-airflow] Skip when transient failures occur for now.
Mon, Dec 9, 9:33 PM
nate created D1606: Speculative fix for k8s test failure.
Mon, Dec 9, 8:00 PM
nate accepted D1603: [nightly] fix aws and pyspark.
Mon, Dec 9, 5:17 PM
nate created D1604: Remove pyarrow wheel install from nightly image build.
Mon, Dec 9, 5:15 PM
nate added a comment to D1565: [buildkite] remove dangling images.

@alangenfeld should this be docker system prune instead?

Mon, Dec 9, 5:14 AM

Sat, Dec 7

nate accepted D1571: Document integration image credential reqs.
Sat, Dec 7, 1:22 AM

Fri, Dec 6

nate added a reviewer for D1568: [dagster-airflow] add logging for tests: max.
Fri, Dec 6, 11:24 PM
nate updated the test plan for D1568: [dagster-airflow] add logging for tests.
Fri, Dec 6, 11:23 PM
nate updated the diff for D1568: [dagster-airflow] add logging for tests.

up

Fri, Dec 6, 11:23 PM
nate created D1568: [dagster-airflow] add logging for tests.
Fri, Dec 6, 11:22 PM
nate accepted D1565: [buildkite] remove dangling images.

maybe add a comment on what this is for future versions of us?

Fri, Dec 6, 10:14 PM
nate added inline comments to D1564: RFC: Use Config Type instances instead of classes; kill inst().
Fri, Dec 6, 9:56 PM
nate accepted D1546: ML Pipeline Outline.
Fri, Dec 6, 9:51 PM
nate accepted D1562: [core] guard against solid def name collisions.
Fri, Dec 6, 9:32 PM
nate retitled D1560: Python 3.8 support in buildkite from First cut at python 3.8 support to Python 3.8 support in buildkite.
Fri, Dec 6, 9:16 PM
nate updated the diff for D1560: Python 3.8 support in buildkite.

up

Fri, Dec 6, 9:14 PM
nate updated the diff for D1560: Python 3.8 support in buildkite.

up

Fri, Dec 6, 9:13 PM
nate updated the diff for D1560: Python 3.8 support in buildkite.

up

Fri, Dec 6, 9:05 PM
nate updated the diff for D1560: Python 3.8 support in buildkite.

rebase

Fri, Dec 6, 8:55 PM
nate abandoned D1561: Pin colorama.
Fri, Dec 6, 8:54 PM
nate updated the diff for D1561: Pin colorama.

up

Fri, Dec 6, 8:53 PM
nate updated the diff for D1561: Pin colorama.

up

Fri, Dec 6, 8:35 PM
nate updated the diff for D1561: Pin colorama.

up

Fri, Dec 6, 8:34 PM
nate created D1561: Pin colorama.
Fri, Dec 6, 8:17 PM
nate updated the diff for D1560: Python 3.8 support in buildkite.

up

Fri, Dec 6, 8:10 PM
nate created D1560: Python 3.8 support in buildkite.
Fri, Dec 6, 8:05 PM
nate requested changes to D1546: ML Pipeline Outline.

this is awesome. bumping back to your queue for the changes above

Fri, Dec 6, 7:35 PM
nate added inline comments to D1546: ML Pipeline Outline.
Fri, Dec 6, 7:34 PM
Next