Page MenuHomeElementl

Add an example of how to trigger a pipeline by graphQL
ClosedPublic

Authored by yichendai on Feb 11 2021, 1:55 AM.
Tags
None
Referenced Files
Unknown Object (File)
Sat, Mar 25, 12:25 AM
Unknown Object (File)
Tue, Mar 21, 9:57 PM
Unknown Object (File)
Thu, Mar 9, 9:09 AM
Unknown Object (File)
Thu, Mar 9, 5:50 AM
Unknown Object (File)
Sat, Mar 4, 10:50 AM
Unknown Object (File)
Feb 16 2023, 2:15 PM
Unknown Object (File)
Feb 15 2023, 5:22 AM
Unknown Object (File)
Feb 8 2023, 4:17 AM
Subscribers

Details

Summary

Use a script to kick off a pipeline run.

Test Plan

test_trigger_pipeline.py

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

this is pretty good, couple of nits in the comments. it might be nice to also explain the graphql query a little bit.

docs/next/src/pages/examples/trigger_pipeline.mdx
36

how does the user know what inputs to use for repositoryLocationName and repositoryName?

37

helpful to clarify that runConfigData is the same as the run_config parameter to execute_pipeline

54

which input?

examples/trigger_pipeline/requirements.txt
1 ↗(On Diff #31235)

do we need this file if the requirements are specified in setup.py

examples/trigger_pipeline/tests/test_trigger_pipeline.py
27

after you send the kill signal, you should proc.wait() to ensure it actually exits

35

in general it's helpful to call out magic numbers like this by making them global constants with explicit names like DAGIT_STARTUP_TIMEOUT

40

you can use an f-string for this

This revision is now accepted and ready to land.Feb 16 2021, 10:12 PM
yichendai added inline comments.
examples/trigger_pipeline/requirements.txt
1 ↗(On Diff #31235)

Lint has highlighted importing gql problem before for some reason. It should be okay to remove this file now. See updates.

examples/trigger_pipeline/tests/test_trigger_pipeline.py
35

This means we should make it clear the 15 is the DAGIT_STARTUP_TIMEOUT. See updates for the change.

yichendai marked 2 inline comments as done.

Update tests and add some clarification on docs