HomePhabricator

[cron] Save dagster-graphql runs to filesystem

Authored by Sashank Thupukari <s@thupukari.com> on Aug 5 2019, 9:51 PM.

Description

[cron] Save dagster-graphql runs to filesystem

Summary:

  • Add --log and --log-dir flags to dagster-graphql to save runs
  • Create --log-dir directory if it doesn't exist

Test Plan:
Run

dagster-graphql -v "cat variables.txt`" -y repository.yaml "cat query.graphql" --log`

File contents:

variables.txt

{
  "executionParams": {
    "environmentConfigData": {
      "storage": {
        "filesystem": null
      }
    },
    "selector": {
      "name": "many_events",
      "solidSubset": null
    },
    "mode": "default"
  }
}

query.graphql

mutation StartPipelineExecution($executionParams: ExecutionParams!) {
  startPipelineExecution(executionParams: $executionParams) {
    __typename
    ... on StartPipelineExecutionSuccess {
      run {
        runId
        __typename
      }
      __typename
    }
    ... on PipelineNotFoundError {
      message
      __typename
    }
    ... on PipelineConfigValidationInvalid {
      errors {
        message
        __typename
      }
      __typename
    }
  }
}

Shows up in dagit:

Reviewers: #ft, alangenfeld

Reviewed By: #ft, alangenfeld

Subscribers: alangenfeld

Differential Revision: https://dagster.phacility.com/D765

Details

Committed
Sashank Thupukari <s@thupukari.com>Aug 5 2019, 10:46 PM
Reviewer
Restricted Project
Differential Revision
D765: [cron] Save dagster-graphql runs to filesystem
Parents
R1:6e2badd07815: New GE-Dagster integration prototype
Branches
Unknown
Tags
Unknown