HomePhabricator

Support for pipeline tags

Authored by prha on Mar 19 2020, 4:40 PM.

Description

Support for pipeline tags

Summary:
Allows users to specify tags on pipeline definitions.

These will resolve in the following cases:

  1. Loading in the playground view will pre-populate the tag container
  2. Loading partition sets from the preset/config picker will pre-populate the tag container with the union of pipeline tags and partition tags, with partition tags taking precedence
  3. Executing from the CLI will generate runs with the pipeline tags
  4. Executing programmatically using the execute_pipeline api will create a run with the union of pipeline tags and RunConfig tags, with RunConfig tags taking precedence
  5. Scheduled runs (both launched and executed) will have the union of pipeline tags and the schedule tags function, with the schedule tags taking precedence

Test Plan: Added tests for both default and overrides for execute_pipeline and the schedule graphql endpoints

Reviewers: alangenfeld, max, sashank

Reviewed By: alangenfeld

Differential Revision: https://dagster.phacility.com/D2282

Details

Committed
prhaMar 19 2020, 5:12 PM
Reviewer
alangenfeld
Differential Revision
D2282: Support for pipeline tags
Parents
R1:314b29b249fe: fix intermediates re-execution in tutorial
Branches
Unknown
Tags
Unknown