Re: [PULL 00/41] testing updates (vm, gitlab, misc build fixes)

[Alex Bennée]

Alex Bennée <alex.bennee@linaro.org> writes:

> There will be some docker failures until the official repository has
> seeded but local builds should continue to work.

You can force the docker builds to use my registry for example by setting:

  make docker-test-build REGISTRY=registry.gitlab.com/stsquad/qemu
>
> ----
>
> The following changes since commit eb6490f544388dd24c0d054a96dd304bc7284450:
>
>   Merge remote-tracking branch 
> 'remotes/pmaydell/tags/pull-target-arm-20200703' into staging (2020-07-04 
> 16:08:41 +0100)
>
> are available in the Git repository at:
>
>   https://github.com/stsquad/qemu.git tags/pull-testing-and-misc-070720-1
>
> for you to fetch changes up to 6a726e8ca0286e3ed69945abd447099f6f6a903c:
>
>   tests/qht-bench: Adjust threshold computation (2020-07-07 07:57:41 +0100)
>
> ----------------------------------------------------------------
> Testing and build updates:
>
>   - tests/vm support for aarch64 VMs
>   - tests/tcg better cross-compiler detection
>   - update docker tooling to support registries
>   - gitlab build docker images and store in registry
>   - gitlab use docker images for builds
>   - a number of skipIf updates to support move
>   - linux-user MAP_FIXED_NOREPLACE fix
>   - qht-bench compiler tweaks
>   - configure fix for secret keyring
>   - tsan fiber annotation clean-up
>
> ----------------------------------------------------------------
> Alex Bennée (23):
>       tests/vm: switch from optsparse to argparse
>       tests/vm: allow us to take advantage of MTTCG
>       tests/docker: check for an parameters not empty string
>       tests/docker: change tag naming scheme of our images
>       .gitignore: un-ignore .gitlab-ci.d
>       gitlab: build containers with buildkit and metadata
>       tests/docker: add --registry support to tooling
>       tests/docker: add packages needed for check-acceptance
>       tests/acceptance: skip s390x_ccw_vrtio_tcg on GitLab
>       tests/acceptance: fix dtb path for machine_rx_gdbsim
>       tests/acceptance: skip multicore mips_malta tests on GitLab
>       tests/acceptance: skip LinuxInitrd 2gib with v4.16 on GitLab
>       gitlab: add acceptance testing to system builds
>       tests/tcg: add more default compilers to configure.sh
>       tests/docker: add a linux-user testing focused image
>       linux-user/elfload: use MAP_FIXED_NOREPLACE in pgb_reserved_va
>       gitlab: enable check-tcg for linux-user tests
>       gitlab: add avocado asset caching
>       gitlab: split build-disabled into two phases
>       gitlab: limit re-builds of the containers
>       containers.yml: build with docker.py tooling
>       testing: add check-build target
>       shippable: pull images from registry instead of building
>
> Daniel P. Berrangé (3):
>       gitlab: introduce explicit "container" and "build" stages
>       gitlab: build all container images during CI
>       gitlab: convert jobs to use custom built containers
>
> David Edmondson (1):
>       crypto/linux_keyring: fix 'secret_keyring' configure test
>
> Richard Henderson (2):
>       tests/qht-bench: Adjust testing rate by -1
>       tests/qht-bench: Adjust threshold computation
>
> Robert Foley (10):
>       util/coroutine: Cleanup start_switch_fiber_ for TSAN.
>       tests/vm: pass args through to BaseVM's __init__
>       tests/vm: Add configuration to basevm.py
>       tests/vm: Added configuration file support
>       tests/vm: Add common Ubuntu python module
>       tests/vm: Added a new script for ubuntu.aarch64.
>       tests/vm: Added a new script for centos.aarch64.
>       tests/vm: change scripts to use self._config
>       python/qemu: Add ConsoleSocket for optional use in QEMUMachine
>       tests/vm: Add workaround to consume console
>
> Thomas Huth (2):
>       gitlab-ci: Fix the change rules after moving the YML files
>       travis.yml: Test also the other targets on s390x
>
>  configure                                          |  31 +-
>  linux-user/elfload.c                               |  10 +-
>  tests/qht-bench.c                                  |  40 ++-
>  util/coroutine-ucontext.c                          |  52 ++--
>  .gitignore                                         |   1 +
>  .gitlab-ci.d/containers.yml                        | 263 ++++++++++++++++
>  .gitlab-ci.d/edk2.yml                              |   5 +-
>  .gitlab-ci.d/opensbi.yml                           |   5 +-
>  .gitlab-ci.yml                                     | 281 ++++++++++-------
>  .shippable.yml                                     |   8 +-
>  .travis.yml                                        |  62 ++--
>  python/qemu/console_socket.py                      | 110 +++++++
>  python/qemu/machine.py                             |  23 +-
>  tests/Makefile.include                             |  19 +-
>  tests/acceptance/boot_linux.py                     |   2 +
>  tests/acceptance/linux_initrd.py                   |   3 +
>  tests/acceptance/machine_mips_malta.py             |   3 +
>  tests/acceptance/machine_rx_gdbsim.py              |   2 +-
>  tests/acceptance/replay_kernel.py                  |   2 +-
>  tests/docker/Makefile.include                      |  17 +-
>  tests/docker/common.rc                             |   2 +-
>  tests/docker/docker.py                             |  46 ++-
>  .../dockerfiles/debian-all-test-cross.docker       |  53 ++++
>  tests/docker/dockerfiles/debian-alpha-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-amd64-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-amd64.docker       |   2 +-
>  tests/docker/dockerfiles/debian-arm64-cross.docker |   2 +-
>  .../dockerfiles/debian-arm64-test-cross.docker     |   2 +-
>  tests/docker/dockerfiles/debian-armel-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-armhf-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-hppa-cross.docker  |   2 +-
>  tests/docker/dockerfiles/debian-m68k-cross.docker  |   2 +-
>  tests/docker/dockerfiles/debian-mips-cross.docker  |   2 +-
>  .../docker/dockerfiles/debian-mips64-cross.docker  |   2 +-
>  .../dockerfiles/debian-mips64el-cross.docker       |   2 +-
>  .../docker/dockerfiles/debian-mipsel-cross.docker  |   2 +-
>  .../docker/dockerfiles/debian-powerpc-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-ppc64-cross.docker |   2 +-
>  .../docker/dockerfiles/debian-ppc64el-cross.docker |   2 +-
>  .../docker/dockerfiles/debian-riscv64-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-s390x-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-sh4-cross.docker   |   2 +-
>  .../docker/dockerfiles/debian-sparc64-cross.docker |   2 +-
>  .../docker/dockerfiles/debian-tricore-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-win32-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian-win64-cross.docker |   2 +-
>  tests/docker/dockerfiles/debian9-mxe.docker        |   2 +-
>  tests/docker/dockerfiles/fedora.docker             |   7 +
>  tests/docker/dockerfiles/ubuntu2004.docker         |  10 +-
>  tests/tcg/Makefile.qemu                            |   4 +-
>  tests/tcg/configure.sh                             |  19 +-
>  tests/vm/Makefile.include                          |  22 ++
>  tests/vm/aarch64vm.py                              | 106 +++++++
>  tests/vm/basevm.py                                 | 344 
> +++++++++++++++------
>  tests/vm/centos-8-aarch64.ks                       |  51 +++
>  tests/vm/centos.aarch64                            | 227 ++++++++++++++
>  tests/vm/conf_example_aarch64.yml                  |  51 +++
>  tests/vm/conf_example_x86.yml                      |  50 +++
>  tests/vm/fedora                                    |  17 +-
>  tests/vm/freebsd                                   |  16 +-
>  tests/vm/netbsd                                    |  19 +-
>  tests/vm/openbsd                                   |  17 +-
>  tests/vm/ubuntu.aarch64                            |  68 ++++
>  tests/vm/ubuntu.i386                               |  46 +--
>  tests/vm/ubuntuvm.py                               |  60 ++++
>  65 files changed, 1839 insertions(+), 383 deletions(-)
>  create mode 100644 .gitlab-ci.d/containers.yml
>  create mode 100644 python/qemu/console_socket.py
>  create mode 100644 tests/docker/dockerfiles/debian-all-test-cross.docker
>  create mode 100644 tests/vm/aarch64vm.py
>  create mode 100644 tests/vm/centos-8-aarch64.ks
>  create mode 100755 tests/vm/centos.aarch64
>  create mode 100644 tests/vm/conf_example_aarch64.yml
>  create mode 100644 tests/vm/conf_example_x86.yml
>  create mode 100755 tests/vm/ubuntu.aarch64
>  create mode 100644 tests/vm/ubuntuvm.py


-- 
Alex Bennée