Page MenuHomeElementl

[dagit] Fix issue rendering Gantt for dynamic pipelines with a collect that has non-dynamic inputs
ClosedPublic

Authored by bengotow on May 7 2021, 8:02 PM.

Details

Summary

This extends the demo pipeline slightly to cover a test case created by a user in Slack - I also refactored and commented the algorithm responsible for this so it's easier to follow.

This diff also tweaks the algorithm slightly so that upcoming (un-executed) dynamic paths are still included in the "planned" steps while the run is executing. When all of the parent steps have run, the placeholder is removed and we use the invocations observed in the logs (which may be zero). Video here:

Test Plan

Run tests, Run dynamic_pipeline with new structure

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

Show the placeholder dynamic step until the upstream steps succeed

Add missing case triggered when run is half complete

This revision is now accepted and ready to land.May 10 2021, 2:04 PM