crosvm/tools/impl
Dennis Kempin 21ec73fc4c test runner: Allow retries of flaky tests
The test runner can now repeat tests in two ways:

- Via --repeat to run tests multiple times and fail if any one of them
  fails. Which will help us find flakes in post-submit.
- Via --retry, which will retry a test if it has failed. Which makes
  pre-submit tests more resilient to flakes.

Both can be configured by builder configs to adjust as needed.

Also slighly changes the repeat behavior to repeat tests in batches, so
we do not run the same test multiple times simultaneously, which can
cause some of them to fail. It's also easier to read the results.

BUG=b:238232551
TEST=added a random flake into some tests and used --repeat and --retry

Change-Id: I78e0ff0751da40a99a56080d9baf207307c9e93a
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/platform/crosvm/+/3751835
Tested-by: Dennis Kempin <denniskempin@google.com>
Reviewed-by: Daniel Verkamp <dverkamp@chromium.org>
2022-07-08 20:41:40 +00:00
..
dev_container dev_container: Allow cargo home to be cached between runs 2022-07-07 17:49:47 +00:00
testvm
__init__.py
bindgen-common.sh
check_code_hygiene.py
common.py merge_bot: Enable on luci 2022-06-08 17:20:27 +00:00
test_config.py tools/run_tests: Use triples for arch 2022-07-01 19:16:59 +00:00
test_runner.py test runner: Allow retries of flaky tests 2022-07-08 20:41:40 +00:00
test_target.py tools: fix triple shorthand error printing 2022-07-07 17:36:27 +00:00
testvm.py tools: Make run_tests python3.8 compatible 2022-06-24 21:53:48 +00:00