HomeElementl

test: add retries to individual tests in helm template suite

Description

test: add retries to individual tests in helm template suite

Summary:
There have been an unbearable number of flakes in this test suite recently.
Here are other attempts to resolve this.

  • Removes necessity to run helm template twice for debugging. When developing, the user can uncomment it out for local development. But this shouldn't be required in prod since this doubles the chance for a flake.
  • Adds https://github.com/pytest-dev/pytest-rerunfailures#re-run-all-failures to the test suite, so that we retry only the failed tests, rather than retrying the entire suite.

Test Plan: tox, bk

Reviewers: alangenfeld, sidkmenon

Reviewed By: sidkmenon

Differential Revision: https://dagster.phacility.com/D8483

Details

Provenance
rexledesmaAuthored on Jun 19 2021, 3:56 PM
Reviewer
sidkmenon
Differential Revision
D8483: test: add retries to individual tests in helm template suite
Parents
R1:f152cbb98624: Add 'set_dagster_home' flag to instance_for_test
Branches
Unknown
Tags
Unknown