crosvm/infra/recipes/build_linux.proto
Dennis Kempin 21ec73fc4c test runner: Allow retries of flaky tests
The test runner can now repeat tests in two ways:

- Via --repeat to run tests multiple times and fail if any one of them
  fails. Which will help us find flakes in post-submit.
- Via --retry, which will retry a test if it has failed. Which makes
  pre-submit tests more resilient to flakes.

Both can be configured by builder configs to adjust as needed.

Also slighly changes the repeat behavior to repeat tests in batches, so
we do not run the same test multiple times simultaneously, which can
cause some of them to fail. It's also easier to read the results.

BUG=b:238232551
TEST=added a random flake into some tests and used --repeat and --retry

Change-Id: I78e0ff0751da40a99a56080d9baf207307c9e93a
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/platform/crosvm/+/3751835
Tested-by: Dennis Kempin <denniskempin@google.com>
Reviewed-by: Daniel Verkamp <dverkamp@chromium.org>
2022-07-08 20:41:40 +00:00

18 lines
584 B
Protocol Buffer

// Copyright 2022 The Chromium OS Authors. All rights reserved.
// Use of this source code is governed by a BSD-style license that can be
// found in the LICENSE file.
syntax = "proto3";
package recipes.crosvm.build_linux;
message BuildLinuxProperties {
// Architecture to test. See `crosvm/tools/run_tests`
optional string test_arch = 1;
// Whether or not to test the crosvm-direct feature.
optional bool crosvm_direct = 2;
// Repeat the the tests multiple times.
optional uint32 repeat_tests = 3;
// Retry tests if they failed.
optional uint32 retry_tests = 4;
}