crosvm/infra/recipes
Dennis Kempin 21ec73fc4c test runner: Allow retries of flaky tests
The test runner can now repeat tests in two ways:

- Via --repeat to run tests multiple times and fail if any one of them
  fails. Which will help us find flakes in post-submit.
- Via --retry, which will retry a test if it has failed. Which makes
  pre-submit tests more resilient to flakes.

Both can be configured by builder configs to adjust as needed.

Also slighly changes the repeat behavior to repeat tests in batches, so
we do not run the same test multiple times simultaneously, which can
cause some of them to fail. It's also easier to read the results.

BUG=b:238232551
TEST=added a random flake into some tests and used --repeat and --retry

Change-Id: I78e0ff0751da40a99a56080d9baf207307c9e93a
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/platform/crosvm/+/3751835
Tested-by: Dennis Kempin <denniskempin@google.com>
Reviewed-by: Daniel Verkamp <dverkamp@chromium.org>
2022-07-08 20:41:40 +00:00
..
build_chromeos.expected
build_linux.expected test runner: Allow retries of flaky tests 2022-07-08 20:41:40 +00:00
build_windows.expected
health_check.expected
push_to_github.expected
push_to_github.resources
update_chromeos_merges.expected
build_chromeos.proto
build_chromeos.py
build_linux.proto test runner: Allow retries of flaky tests 2022-07-08 20:41:40 +00:00
build_linux.py test runner: Allow retries of flaky tests 2022-07-08 20:41:40 +00:00
build_windows.py
health_check.py
push_to_github.py
update_chromeos_merges.py