Page MenuHomeElementl

Add the mode's available resources to error message if resource requirements check fails
ClosedPublic

Authored by rexledesma on May 25 2021, 9:39 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sat, May 20, 12:28 PM
Unknown Object (File)
Sat, May 20, 9:54 AM
Unknown Object (File)
Fri, May 19, 11:37 PM
Unknown Object (File)
Tue, May 16, 8:51 PM
Unknown Object (File)
Mon, May 15, 8:32 PM
Unknown Object (File)
Sun, May 14, 7:41 AM
Unknown Object (File)
Sat, Apr 29, 9:10 PM
Unknown Object (File)
Apr 15 2023, 5:39 AM
Subscribers
None

Details

Summary

If this check fails due to a typo in specifying the required resource key from the user's end,
this will display all the possible resources they can choose from or prompts the user
to define the actual resource for the selected mode.

Test Plan

tbd

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

rexledesma held this revision as a draft.

In cases where we're reasonably sure someone made a typo; i think it makes sense to communicate that there's a resource key that is similar to the one they provided. In the general case of someone missing a resource however, I'm not sure what the benefit of displaying keys is, however. Would the intention be that someone could see which resource keys are available, and change their definition to use that resource key instead? If that's the case, I think we might want to orient the language more around resource keys than definitions, since that's what we would expect people to be switching around.

python_modules/dagster/dagster/core/definitions/pipeline.py
652

nit: OutputManagerDefinition subsumes IOManagerDefinition. I think it's fine to keep it as just IOManagerDefinition

either re-orienting language around providing resource for resource key / switching resource key, or some sort of levenshtein distance "did you mean __?" error message (not sure if we have a precedent for something like this in the codebase yet)

This revision now requires changes to proceed.May 26 2021, 4:49 PM

In the general case of someone missing a resource however, I'm not sure what the benefit of displaying keys is, however.

@cdecarolis I think there are two cases here:

  1. They used the wrong resource key in their solid definition (it's a typo)
  2. They used the correctly intended resource key, but the resource key is not defined in their mode yet.

Since we can't tell which case it is, the error message isn't prescriptive on what should be changed. But adding that the resource "must be defined" solves for case (2), and showing the possible resources that are available solves for case (1) as they can see they misspelled the resource key compared to what they provided.

Awesome. Thanks for tackling this!

This revision is now accepted and ready to land.May 27 2021, 12:17 AM