Page MenuHomeElementl

[dagit] Lazy-load partition set info for Schedules

Authored by dish on Aug 3 2021, 7:00 PM.
Referenced Files
F2774643: D9202.id42784.diff
Sun, Feb 5, 8:40 PM
Unknown Object (File)
Sun, Feb 5, 3:40 AM
Unknown Object (File)
Thu, Jan 26, 8:55 PM
Unknown Object (File)
Mon, Jan 16, 12:47 PM
Unknown Object (File)
Jan 3 2023, 4:29 PM
Unknown Object (File)
Dec 29 2022, 12:21 AM
Unknown Object (File)
Dec 27 2022, 8:05 PM
Unknown Object (File)
Dec 26 2022, 1:18 PM



We currently load a ton of data for partition sets when viewing schedules, including in the "Instance status" page view of all schedules on the instance. This can be really slow, and blocks the entire query.

Separate loading partition set data into lazy subqueries that can be triggered by request from the user.

Test Plan

View /instance/schedules. Verify that the "Partition status" column has links that allow lazy-loading the partition set data. Click, verify proper loading/loaded behavior.

Verify same on Schedule permalink details.

Diff Detail

R1 dagster
Lint Not Applicable
Tests Not Applicable

Event Timeline

we can build and show the link to the partitions page with [1] right?

To me, it makes sense to

  • maybe rename column from "partition status" to "partition"
  • always show the link
  • add a "load stats" or "load status" for this expensive information


The JS changes here look great. I'd +1 showing the partition set name all the time with a link, and then just offering to "Show Coverage" or something like that to reveal "Missing", etc.

This revision is now accepted and ready to land.Aug 4 2021, 3:11 PM

I think Bens "Show Coverage" suggestion is better the "load" ones