Page MenuHomeElementl

test: add retries to individual tests in helm template suite
ClosedPublic

Authored by rexledesma on Jun 19 2021, 4:00 PM.
Tags
None
Referenced Files
Unknown Object (File)
Fri, Feb 3, 11:45 AM
Unknown Object (File)
Wed, Jan 25, 5:29 AM
Unknown Object (File)
Thu, Jan 19, 3:56 PM
Unknown Object (File)
Thu, Jan 12, 5:54 PM
Unknown Object (File)
Dec 28 2022, 12:50 AM
Unknown Object (File)
Dec 25 2022, 9:57 PM
Unknown Object (File)
Nov 18 2022, 12:07 AM
Unknown Object (File)
Nov 18 2022, 12:07 AM
Subscribers
None

Details

Summary

There have been an unbearable number of flakes in this test suite recently.
Here are other attempts to resolve this.

  • Removes necessity to run helm template twice for debugging. When developing, the user can uncomment it out for local development. But this shouldn't be required in prod since this doubles the chance for a flake.
  • Adds https://github.com/pytest-dev/pytest-rerunfailures#re-run-all-failures to the test suite, so that we retry only the failed tests, rather than retrying the entire suite.
Test Plan

tox, bk

Diff Detail

Repository
R1 dagster
Lint
Lint Not Applicable
Unit
Tests Not Applicable