crosvm/kokoro
Daniel Verkamp 05259303e4 kokoro: use version specified in rust-toolchain
Update the default Rust toolchain to the version specified in the
rust-toolchain file (which is part of the crosvm source directory, not
baked into the Docker image) during each kokoro run.

This will let us seamlessly update rust-toolchain without breaking the
builds using the existing kokoro Docker image once this change is in
place.

BUG=None
TEST=Build image with 1.31.0, then run test with rust-toolchain 1.32.0

Change-Id: If4f6dffc20af33011d2a96a0cf6b3db3582a2fd0
Signed-off-by: Daniel Verkamp <dverkamp@chromium.org>
Reviewed-on: https://chromium-review.googlesource.com/1470914
Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com>
Tested-by: kokoro <noreply+kokoro@google.com>
Reviewed-by: David Tolnay <dtolnay@chromium.org>
Reviewed-by: Zach Reizner <zachr@chromium.org>
2019-02-19 22:15:20 -08:00
..
pkgconfig
build.sh kokoro: Move the crosvm workdir 2019-01-26 00:59:57 -08:00
continuous.cfg
Dockerfile kokoro: use version specified in rust-toolchain 2019-02-19 22:15:20 -08:00
kokoro_simulator.sh
presubmit-cr.cfg
presubmit.cfg
README.md kokoro: Move the crosvm workdir 2019-01-26 00:59:57 -08:00

Kokoro CI for crosvm

For presubmit testing, each change posted for Gerrit on the master branch of crosvm will be tried by Kokoro. The configuration is found in presubmit.cfg and the build script is at build.sh. A Docker image called crosvm-base is used as the testing environment which is built with a Dockerfile.

[TOC]

How to use Docker to test crosvm

Assuming a Docker daemon is already running, build the crosvm-base image:

docker build -t crosvm-base path/to/crosvm/kokoro

Here is how to use the image to test a crosvm repository located at $CROSVM_SRC:

docker run --privileged -v /dev/log:/dev/log -v "${CROSVM_SRC}":/platform/crosvm:ro crosvm-base

WARNING: The --privileged is so that the container will have /dev/kvm access.

How to update crosvm-base

The crosvm-base Dockerfile downloads, builds, and install specific library versions needed to test crosvm. It also defines a run time environment and default command line for performing a test. If an update or new library is needed or any other adjustment is required, a new image can be generated as follows:

docker build -t crosvm-base path/to/crosvm/kokoro
docker save crosvm-base | xz -T 0 -z >crosvm-base.tar.xz

If you have x20 access, move crosvm-base.tar.xz to /teams/chromeos-vm/docker/ and ensure the owner is chromeos-vm-ci-read-write. This owner is used to allow Kokoro to read the base image in during the test run. The updated image will be used for future Kokoro runs until it is replaced.

prodaccess
cp crosvm-base.tar.xz /google/data/rw/teams/chromeos-vm/docker/

The cp command should preserve the right owner but to be sure you can confirm that it is chromeos-vm-ci-read-write in the web ui: https://x20.corp.google.com/teams/chromeos-vm/docker

WARNING: If the image tarball uploaded to x20 is defective in any way, Kokoro will fail to verify every crosvm change as if the change itself were defective. Please verify the image is good before uploading to x20.

How to simulate Kokoro before uploading

If you want to test a change before uploading it in a similar environment to Kokoro, use the kokoro_simulator.sh script. It will invoke the build.sh script after exporting environment variables and a volume that are expected to be present. The crosvm source code is symlinked in, and is tested exactly as in the working directory. Any changes to build.sh will also be tested, but any changes to presubmit.cfg will have no effect. If there are any changes to Dockerfile, they will have no effect unless the crosvm-base image is removed (or never existed) from the local Docker daemon. To test Dockerfile changes use the following formula to purge crosvm-base.

# So that kokoro_simulator.sh doesn't skip `docker save`.
rm /tmp/kokoro_simulator/crosvm-base.tar.xz

# Stopped containers prevent the removal of images below.
docker container prune

# So that kokoro_simulator.sh doesn't skip `docker build`.
docker rmi crosvm-base