lmi
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[lmi] Running unit tests in less time


From: Greg Chicares
Subject: [lmi] Running unit tests in less time
Date: Fri, 6 Jan 2017 15:27:15 +0000
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Icedove/45.4.0

See commit a905d1969eac34f599c7b6ef4f3856a606d33be1 .

Timings with all test programs already built...before that commit:

/opt/lmi/src/lmi[0]$time make $coefficiency unit_tests >../log-old 2>&1
make $coefficiency unit_tests > ../log-old 2>&1  25.23s user 3.32s system 85% 
cpu 33.445 total

...and after that commit:

/opt/lmi/src/lmi[0]$time make $coefficiency unit_tests >../log 2>&1
make $coefficiency unit_tests > ../log 2>&1  25.45s user 4.68s system 304% cpu 
9.906 total

33.445 / 9.906 = 3.4 times as fast

As always with parallel tests (given excess CPUs), the total time
is the time it takes to run the slowest test:

/opt/lmi/src/lmi[0]$time make $coefficiency unit_tests 
unit_test_targets=calendar_date_test.exe >../log 2>&1
make $coefficiency unit_tests unit_test_targets=calendar_date_test.exe >  2>&  
9.52s user 0.14s system 98% cpu 9.812 total

[How strange that 'time' scrambled the redirection
- >../log 2>&1
+  >  2>&
when echoing it back.]

In one trial, I saw:

Running premium_tax_test:

** uncaught exception: std::runtime_error: Unable to parse xml file 
'Z:/opt/lmi/src/build/lmi/Linux/gcc/ship/sample.policy': Document is empty
[file /opt/lmi/src/lmi/xml_lmi.cpp, line 69]

which would seem to be the problem discussed here:

http://lists.nongnu.org/archive/html/lmi/2014-10/msg00018.html
http://lists.nongnu.org/archive/html/lmi/2014-10/msg00019.html

I hadn't seen it again until today. I speculate that it might occur
only the first time the unit tests are run after 'make clean', which
would mean that it's not a high enough priority to fix right now,
unless it keeps arising.



reply via email to

[Prev in Thread] Current Thread [Next in Thread]