Page MenuHomePhabricator

rename s3_io_manager to s3_pickled_io_manager, adls2_io_manager to adls2_pickled_io_manager, and gcs_io_manager to gcs_pickled_io_manager.
ClosedPublic

Authored by cdecarolis on Jan 12 2021, 9:13 PM.

Details

Summary

This diff renames the default io managers to their pickled counterparts. This change is worth doing for two reasons: 1. expose to the user what's actually happening under the hood, 2. Leave open the possibility of including a more generic io_manager for each of these storage options that performs serialization based on the dagster type.

Test Plan

Unit tests

Diff Detail

Repository
R1 dagster
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.