[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [PATCH 03/10] tests/avocado/intel_iommu.py: increase timeout
From: |
Alex Bennée |
Subject: |
Re: [PATCH 03/10] tests/avocado/intel_iommu.py: increase timeout |
Date: |
Mon, 11 Dec 2023 17:01:43 +0000 |
User-agent: |
mu4e 1.11.26; emacs 29.1 |
Cleber Rosa <crosa@redhat.com> writes:
> Based on many runs, the average run time for these 4 tests is around
> 250 seconds, with 320 seconds being the ceiling. In any way, the
> default 120 seconds timeout is inappropriate in my experience.
I would rather see these tests updated to fix:
- Don't use such an old Fedora 31 image
- Avoid updating image packages (when will RH stop serving them?)
- The "test" is a fairly basic check of dmesg/sysfs output
I think building a buildroot image with the tools pre-installed (with
perhaps more testing) would be a better use of our limited test time.
FWIW the runtime on my machine is:
➜ env QEMU_TEST_FLAKY_TESTS=1 ./pyvenv/bin/avocado run
./tests/avocado/intel_iommu.py
JOB ID : 5c582ccf274f3aee279c2208f969a7af8ceb9943
JOB LOG : /home/alex/avocado/job-results/job-2023-12-11T16.53-5c582cc/job.log
(1/4) ./tests/avocado/intel_iommu.py:IntelIOMMU.test_intel_iommu: PASS (44.21
s)
(2/4) ./tests/avocado/intel_iommu.py:IntelIOMMU.test_intel_iommu_strict: PASS
(78.60 s)
(3/4) ./tests/avocado/intel_iommu.py:IntelIOMMU.test_intel_iommu_strict_cm:
PASS (65.57 s)
(4/4) ./tests/avocado/intel_iommu.py:IntelIOMMU.test_intel_iommu_pt: PASS
(66.63 s)
RESULTS : PASS 4 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME : 255.43 s
--
Alex Bennée
Virtualisation Tech Lead @ Linaro
- [PATCH 02/10] tests/avocado: mips: add hint for fetchasset plugin, (continued)
- [PATCH 02/10] tests/avocado: mips: add hint for fetchasset plugin, Cleber Rosa, 2023/12/08
- [PATCH 06/10] tests/avocado/kvm_xen_guest.py: cope with asset RW requirements, Cleber Rosa, 2023/12/08
- [PATCH 09/10] tests/avocado/boot_xen.py: unify tags, Cleber Rosa, 2023/12/08
- [PATCH 05/10] tests/avocado: use more distinct names for assets, Cleber Rosa, 2023/12/08
- [PATCH 03/10] tests/avocado/intel_iommu.py: increase timeout, Cleber Rosa, 2023/12/08
- Re: [PATCH 03/10] tests/avocado/intel_iommu.py: increase timeout, Philippe Mathieu-Daudé, 2023/12/14
[PATCH 10/10] tests/avocado/boot_xen.py: use class attribute, Cleber Rosa, 2023/12/08
[PATCH 08/10] tests/avocado/boot_xen.py: merge base classes, Cleber Rosa, 2023/12/08