Page MenuHomeElementl

eliminate-intermediate-1 multiprocess call sites
Changes PlannedPublicDraft

Authored by yuhan on Mar 8 2021, 6:04 PM.

Details

Reviewers
None
Test Plan

bk

Diff Detail

Repository
R1 dagster
Branch
yuhan/intermediate-storage
Lint
Lint Passed
Unit
No Test Coverage

Event Timeline

Harbormaster returned this revision to the author for changes because remote builds failed.Mar 8 2021, 6:23 PM
Harbormaster failed remote builds in B26975: Diff 32984!
python_modules/dagster/dagster_tests/core_tests/engine_tests/test_multiprocessing.py
44–50
execute_pipeline(
            pipe,
            run_config={
                "execution": {"multiprocess": {}},
            },
            resource_defs={"io_manager": fs_io_manager},
            instance=instance,
        )
82–84
mode_defs=[

           ModeDefinition("default", resource_defs={"io_manager": mem_io_manager}),
           ModeDefinition("multi", resource_defs={"io_manager": fs_io_manager}),

       ],