HomeElementl

dagstermill - fix: yield_result temp path includes solid name

Description

dagstermill - fix: yield_result temp path includes solid name

Summary:
fix a bug where yield_result wrote output value to the same file path if output names are the same for different solids.
it caused random serdes error in multiproc bc write and read could happen the same time for different objects to the same file

Test Plan:
unit - fan_in_notebook_pipeline is the repro

before the fix, both solids yield "world" because one overwrites the other:

Screen Shot 2021-07-25 at 11.37.55 PM.png (776×2 px, 351 KB)

Reviewers: alangenfeld, max

Reviewed By: alangenfeld

Differential Revision: https://dagster.phacility.com/D9053

Details

Provenance
yuhanAuthored on Jul 26 2021, 6:48 AM
Reviewer
alangenfeld
Differential Revision
D9053: dagstermill - fix: yield_result temp path includes solid name
Parents
R1:29797eb9c6c9: Use grpc rather than ipc to decide if a grpc server is running" - with…
Branches
Unknown
Tags
Unknown