HomeElementl

Add an ecr_public_resource

Description

Add an ecr_public_resource

Summary:
I'm going to use this in our release pipeline but it seemed simple enough
and potentially valuable enough that it was worth adding to dagster_aws.

This adds both an ecr_public_resource and a
fake_ecr_public_resource. The real one mimics the behavior of `aws
ecr-public get-login-password` (which is just a convenience wrapper
around aws ecr-public get-authentication-token that parses the token
out of the response). The fake one stubs the AWS API requests so that it
always returns the string "token" as its password.

Pipelines that interact with ECR Public can uses this resource to get
login credentials. Local/development mode definitions can use the fake
resource and production mode definitions can use the real resource.

Both resources authenticate using the default boto3 credential lookup
order starting at step 3 (Environment variables):

https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html#configuring-credentials

Test Plan: unit

Reviewers: alangenfeld, max, dgibson

Reviewed By: alangenfeld

Differential Revision: https://dagster.phacility.com/D8009

Details

Provenance
jordansandersAuthored on May 20 2021, 2:51 PM
Reviewer
alangenfeld
Differential Revision
D8009: Add an ecr_public_resource
Parents
R1:2b45dca4ff4d: adds a resume backfill option, to resubmit the partition backfill to the daemon
Branches
Unknown
Tags
Unknown