Page MenuHomeElementl

[dagit] Fix issue rendering Gantt for dynamic pipelines with a collect that has non-dynamic inputs
ClosedPublic

Authored by bengotow on May 7 2021, 8:02 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sat, May 13, 2:37 PM
Unknown Object (File)
Fri, May 12, 9:48 AM
Unknown Object (File)
Fri, May 12, 6:38 AM
Unknown Object (File)
Thu, May 11, 12:38 PM
Unknown Object (File)
Mon, May 8, 9:19 PM
Unknown Object (File)
Apr 27 2023, 10:56 PM
Unknown Object (File)
Apr 25 2023, 3:00 AM
Unknown Object (File)
Mar 26 2023, 9:43 AM
Subscribers
None

Details

Summary

This extends the demo pipeline slightly to cover a test case created by a user in Slack - I also refactored and commented the algorithm responsible for this so it's easier to follow.

This diff also tweaks the algorithm slightly so that upcoming (un-executed) dynamic paths are still included in the "planned" steps while the run is executing. When all of the parent steps have run, the placeholder is removed and we use the invocations observed in the logs (which may be zero). Video here:

Test Plan

Run tests, Run dynamic_pipeline with new structure

Diff Detail

Repository
R1 dagster
Branch
abg/dynamic-orchestration-fix
Lint
Lint Passed
Unit
No Test Coverage

Event Timeline

Show the placeholder dynamic step until the upstream steps succeed

Add missing case triggered when run is half complete

This revision is now accepted and ready to land.May 10 2021, 2:04 PM