Adds upload_fileobj method to the S3 resource and changes the file_handle_to_s3 solid to use it instead of put_object.
Details
Details
- Reviewers
alangenfeld - Group Reviewers
Restricted Project - Commits
- R1:54586608bcb2: change `file_handle_to_s3` solid to use S3.Client.upload_fileobj
- Ran unittest (while removing a defunct one)
- Hooked up to an actual pipeline uploading to a real S3 bucket (with creds).
- Ran the airline demo warehouse pipeline.
Diff Detail
Diff Detail
- Repository
- R1 dagster
- Lint
Automatic diff as part of commit; lint not applicable. - Unit
Automatic diff as part of commit; unit tests not applicable.
