Page MenuHomeElementl

test: add retries to individual tests in helm template suite
ClosedPublic

Authored by rexledesma on Jun 19 2021, 4:00 PM.

Details

Summary

There have been an unbearable number of flakes in this test suite recently.
Here are other attempts to resolve this.

  • Removes necessity to run helm template twice for debugging. When developing, the user can uncomment it out for local development. But this shouldn't be required in prod since this doubles the chance for a flake.
  • Adds https://github.com/pytest-dev/pytest-rerunfailures#re-run-all-failures to the test suite, so that we retry only the failed tests, rather than retrying the entire suite.
Test Plan

tox, bk

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable