HomePhabricator

refactor in_process engine core to plan_execution_iterator

Authored by alangenfeld on Wed, Mar 18, 3:40 PM.

Description

refactor in_process engine core to plan_execution_iterator

Summary:
A refactor to remove the weird engine -> engine setup we currently have.

The new control flow looks like this:


https://excalidraw.com/#json=5715587808362496,jNlDGr4uOi7FyuTu_UfLoA

  • Retries are a new top level argument to execute_plan APIs
  • changes celery to not go through GraphQL since it didn't really make sense

Test Plan: buildkite

Reviewers: max, schrockn, prha, nate

Reviewed By: schrockn

Differential Revision: https://dagster.phacility.com/D2286

Details