[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Qemu-devel] [PULL 10/19] tests/boot_linux_console: increase timeout
From: |
Cleber Rosa |
Subject: |
Re: [Qemu-devel] [PULL 10/19] tests/boot_linux_console: increase timeout |
Date: |
Wed, 8 May 2019 10:39:53 -0400 |
User-agent: |
Mutt/1.11.4 (2019-03-13) |
On Wed, May 08, 2019 at 12:28:24PM +0200, Gerd Hoffmann wrote:
> On Thu, May 02, 2019 at 09:41:21PM -0300, Eduardo Habkost wrote:
> > From: Cleber Rosa <address@hidden>
> >
> > When running on very low powered environments, some tests may time out
> > causing false negatives. As a conservative change, and for
> > considering that human time (investigating false negatives) is worth
> > more than some extra machine cycles (and time), let's increase the
> > overall timeout.
>
> Tests can also timeout due to slow downloads of test kernels.
> Any chance to run the downloads without timeout?
I acknowledge this is an issue, and have thought about two possible
ways to solve it:
1) Downloading/caching/checking all the test assets in a job "pre-tests"
plugin. This would involve/require:
-
https://trello.com/c/WPd4FrIy/1479-add-support-to-specify-assets-in-test-docstring
- https://trello.com/c/CKP7YS6G/1481-on-cache-check-for-asset-fetcher
2) Report the test phase (say, setUp()) to the test runner, which
would allow the runner to:
- Not take that time into account for the test (similar to
https://github.com/avocado-framework/avocado/pull/3076)
- Retry the setUp a number of times (if the test opts in or doesn't
opt out)
I'm very much interested in your opinion so we can evolve the idea into
implementation.
Thanks!
- Cleber
>
> cheers,
> Gerd
>
- [Qemu-devel] [PULL 02/19] tests/acceptance: improve docstring on pick_default_qemu_bin(), (continued)
- [Qemu-devel] [PULL 02/19] tests/acceptance: improve docstring on pick_default_qemu_bin(), Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 03/19] tests/acceptance: fix doc reference to avocado_qemu directory, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 04/19] tests/acceptance: introduce arch parameter and attribute, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 05/19] tests/acceptance: use "arch:" tag to filter target specific tests, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 06/19] tests/acceptance: look for target architecture in test tags first, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 07/19] tests/boot_linux_console: rename the x86_64 after the arch and machine, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 08/19] tests/boot_linux_console: update the x86_64 kernel, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 09/19] tests/boot_linux_console: add common kernel command line options, Eduardo Habkost, 2019/05/02
- [Qemu-devel] [PULL 10/19] tests/boot_linux_console: increase timeout, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 11/19] tests/boot_linux_console: refactor the console watcher into utility method, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 12/19] scripts/qemu.py: support adding a console with the default serial device, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 13/19] tests/boot_linux_console: add a test for mips + malta, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 15/19] tests/boot_linux_console: add a test for aarch64 + virt, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 14/19] tests/boot_linux_console: add a test for mips64el + malta, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 18/19] tests/boot_linux_console: add a test for alpha + clipper, Eduardo Habkost, 2019/05/02
[Qemu-devel] [PULL 16/19] tests/boot_linux_console: add a test for arm + virt, Eduardo Habkost, 2019/05/02