There have been an unbearable number of flakes in this test suite recently.
Here are other attempts to resolve this.
- Removes necessity to run helm template twice for debugging. When developing, the user can uncomment it out for local development. But this shouldn't be required in prod since this doubles the chance for a flake.
- Adds https://github.com/pytest-dev/pytest-rerunfailures#re-run-all-failures to the test suite, so that we retry only the failed tests, rather than retrying the entire suite.