bug#13832: Tests fail because make runs with more than one jobs

[Joshua C.]

2013/3/5 Stefano Lattarini <address@hidden>:
> tags 13832 + moreinfo
> severity 13832 minor
> stop
>
> Hi Joshua, sorry for the delay.

Don't worry, I'm glad that I got a response, because sometimes some maintainers (on other projects) don't even bother to respond but this is another story...

>
> On 02/27/2013 10:07 AM, Joshua C. wrote:

>> In the last couple of days I encountered a number of different tests
>> that reported a failure with ‘make check’. However in order to save
>> some time I ran ‘make –j4 check’ and this saved me about 75% of the

>> check time (~16min compared to ~62min for ‘make –j1 check’). The
>> reportedly failed tests passed without errors when tested with ‘make
>> –j1 check’. This makes me believe that ‘make’ doesn’t like to be run

>> as a server.
>>
> That is weird, I routinely run the tests with high parallelism myself
> (even with "make -j16"), and have never encountered such an issue.
>
> Can you please send us more details about your system, as well as the

> content of the file 'test-suite.log' left behind after the testsuite
> run?
>

This is a fedora-17 (gcc-4.7.2) with updated autoconf, automake, make, flex and bison. I've uploaded the 'test-suite.log' file and see that it has some more information about the  installed packages.


>> My proposition is: if a test fails for some reason,
>>
> They are not expected to fail.  So we should work out the underlying
> reason for the problem, and fix it.
>
>> can we automatically re-run it with passing ‘-j1’ to make?

>>
>> If it still fails then count the result as a failure, if not – as a
>> success. Can someone take a look at it tries to implement it? I’m
>> not that good at experimenting with make-targets.

>>
>> Tested with:
>>
>> automake: git a5ed87e7944deaea33914230e3d67ff08eb18382
>> autoconf: git 9e087dd343b67ac58a7f54e08335ac62fc33ed53
>> make: git 4baf9ab4564447355b5748d1375959e817771d17

>>
>> Failing tests with ‘make –j4 check’ (these pass fine with ‘make –j1 check’)
>>
>> t/objc-megademo.sh
>> t/ar-lib4.sh
>>
>>
>> --joshua
>>

>>
>
> Regards,
>   Stefano
>



-- 
--joshua

test-suite.log
Description: Binary data