Page MenuHomePhabricator

rename s3_io_manager to s3_pickled_io_manager, adls2_io_manager to adls2_pickled_io_manager, and gcs_io_manager to gcs_pickled_io_manager.
ClosedPublic

Authored by cdecarolis on Jan 12 2021, 9:13 PM.

Details

Summary

This diff renames the default io managers to their pickled counterparts. This change is worth doing for two reasons: 1. expose to the user what's actually happening under the hood, 2. Leave open the possibility of including a more generic io_manager for each of these storage options that performs serialization based on the dagster type.

Test Plan

Unit tests

Diff Detail

Repository
R1 dagster
Branch
io_manager_rename
Lint
Lint OK
Unit
No Unit Test Coverage