Re: [XForms] automated regression tests for XForms

[alessandro basili]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi all,

On 29/01/2013 02:05, Jens Thoms Toerring wrote:
[]
>> Of course, a regression test won't pick up existing bugs but it 
>> opens the way to do bug fixes or major refactoring with 
>> confidence.
> 
> It may even catch some existing bugs when someone takes a closer 
> look at what happens and notices that it isn't what it's supposed 
> to be;-)

that is a key point. Test against 'what is's supposed to be' means
that the documentation should document well the functions in order to
implement the test programs. As Jens said in an earlier message in
this thread, this effort will help also in writing a better documentation.

>> A framework in which any of us can contribute tests would be 
>> nice.   There are a huge number of functions to exercise so
>> it'll need a group effort.
> 
> Definitely! But someone has to get the ball rolling. If Alessandro 
> feels like doing that I at least won't complain;-)

I will first like to get some experience with Xnee, trying to see how
much we can automate testing. I do not want to write any testing
programs for the time being and concentrate more on the machinery.

I will probably need to reiterate more on the general structure of the
testing framework (like scripts, reports, test cases...) in order not
to do a huge work with huge flaws in the design.

Putting some efforts in the design phase will pay back in the long
run, therefore I'm all for it.

If somebody has any experience in testing out there, now it would be a
good chance to throw in some ideas.

Al

- -- 
PGP Fingerprint DCBE 430E E93D 808B 45E6 7B8A F68D A276 565C 4450
PGP Public Key available at keys.gnugp.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (MingW32)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJRB4SOAAoJEPaNonZWXERQYycIAJ2zHq8qdnUWM1ITsNI4YsPS
SAb6YOjrrnxC/z6wuPfEjAoeteuQMnUfVsDvmuvehwC7wfTc1cP5pftOPbOGDKXv
C3o7LZ8zIDmQ1+hGU6T9Hln68noaCH367eEUSw4Ins+xIxwXb27jaDfgIKUlqVOW
mmLnY6+zvkZ3ceg6KYYI+rCoogC+B1M6GvP91fep+L852/pdIFJYO0BPq0JcqWYq
JdgFhScbQCCjVsBKHM7gqEP4u8O53fZynFlfcbBPCwaJvau8bMGbgF0uyFtmFdF/
bUGCmtG40XgA+5uG1qQsl3eiOpZhCfZtyLga9R4SH7aXMbnAzJ7PIHDTkX8WWSs=
=yryx
-----END PGP SIGNATURE-----