[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Qemu-devel] Please read: make check framework
From: |
Paul Brook |
Subject: |
Re: [Qemu-devel] Please read: make check framework |
Date: |
Mon, 9 Jan 2012 17:47:51 +0000 |
User-agent: |
KMail/1.13.7 (Linux/3.1.0-1-amd64; KDE/4.6.5; x86_64; ; ) |
> I'm going to apply this series quickly and will start running 'make
> check-quick' as part a sniff test before pushing patches.
>
> I'd like to request that all maintainers/submaintainers do the same and
> that everyone contributes unit tests to this target.
>
> The general rules for 'make check-quick':
>
> 1) It must complete in less than 10 minutes start to finish (the entire
> rule). We can re-examine this over time but for now, it seems like a
> reasonable limit.
No objection in principle, though I'm a bit unclear on the guidelines.
In particular:
- 10 minutes on what hardware? 10 minutes on one of my fat build machines is
an hour on an average year-old laptop/desktop, and I guess 6+ hours on the
netbook I use when travelling. Maybe relating this to the time taken to do a
clean build would make more sense?
- What level of testing is appropriate? As a maintainer when can/should I
bounce a patch due to lack of tests? e.g should new device emulation come with
unit tests? New infrastructure? What about fixes to both of the above, should
these include regression tests? Given the size of the test surface for many
components (in particular emulated CPUs), I'm guessing we're looking at
extremely basic smoke-tests. Consistent regression tests or any sort of
architecture conformance tests are going to completely blow your time budget.
Obviously level of testing is always a bit of a judgement call - anyone who
claims of have complete test coverage is either lying or writing trivially
uninteresting code. However given qemu has historically had zero active test
coverage I'd appreciate some guidance (as both maintainers and contrubutor).
Paul
- Re: [Qemu-devel] [PATCH 03/11] check-qdict: convert to gtest, (continued)
- [Qemu-devel] [PATCH 11/11] check: add a check-report and check-help target, Anthony Liguori, 2012/01/09
- [Qemu-devel] [PATCH 08/11] check-qjson: convert to gtest, Anthony Liguori, 2012/01/09
- [Qemu-devel] [PATCH 04/11] check-qfloat: convert to gtest, Anthony Liguori, 2012/01/09
- Re: [Qemu-devel] [PATCH 01/11] tests: mv tests/* -> tests/tcg, Andreas Färber, 2012/01/09
- [Qemu-devel] Please read: make check framework, Anthony Liguori, 2012/01/09
- Re: [Qemu-devel] Please read: make check framework, Daniel Gollub, 2012/01/09
- Re: [Qemu-devel] Please read: make check framework,
Paul Brook <=
- Re: [Qemu-devel] Please read: make check framework, Anthony Liguori, 2012/01/09
- Re: [Qemu-devel] Please read: make check framework, Andreas Färber, 2012/01/10
- Re: [Qemu-devel] Please read: make check framework, Anthony Liguori, 2012/01/10
- Re: [Qemu-devel] Please read: make check framework, Andreas Färber, 2012/01/10
- Re: [Qemu-devel] Please read: make check framework, Anthony Liguori, 2012/01/10
- Re: [Qemu-devel] Please read: make check framework, Kevin Wolf, 2012/01/11
- Re: [Qemu-devel] Please read: make check framework, Anthony Liguori, 2012/01/11
- Re: [Qemu-devel] Please read: make check framework, Andreas Färber, 2012/01/11
- Re: [Qemu-devel] Please read: make check framework, Peter Maydell, 2012/01/11
Re: [Qemu-devel] Please read: make check framework, Avi Kivity, 2012/01/09