Re: [Discuss-gnuradio] make test errors

[Josh Blum]

Run volk/lib/test_all from the build dir

If a kernel fails, it will tell you which one, start commenting out its
implementations in the source dir volk/kernels/volk/volk_*.h until the
test works. We narrow down suspect implementation and fix.

-josh

On 06/10/2013 09:57 PM, Dave L wrote:
> The CPU on the laptop is an Intel i3-2350M (64 bit).
> 
> What steps should I take (or where can I learn how) to resolve the problem 
> with Volk?
> 
> Dave
> 
> 
> 
> 
> ________________________________
>  From: Tom Rondeau <address@hidden>
> To: Botany Dave <address@hidden> 
> Sent: Monday, June 10, 2013 6:41 AM
> Subject: Re: [Discuss-gnuradio] make test errors
>  
> 
> On Thu, Jun 6, 2013 at 11:52 PM, Botany Dave <address@hidden> wrote:
>> I'm new to this, and I'm sure it will show...
>>
>> I am trying to install and run Gnu Radio in an Ubuntu 12.10 environment. I
>> followed the instructions at
>> http://gnuradio.org/redmine/projects/gnuradio/wiki/UbuntuInstall#Installation-Overview
>> and am getting errors on four modules when I run make test. They are:
>>
>> 86 - qa_fir_filter
>> 91 - qa_freq__xlating_fir_filter
>> 150 - qa_constellation_receiver
>> 169 - qa_codec2_vocoder
>>
>> Here is the output of ctest -V -R qa for each of those modules. I'd really
>> appreciate any guidance on how to resolve these failures.
>>
>> 86: Test command: /bin/sh
>> "/home/dave/gnuradio/build/gr-filter/python/qa_fir_filter_test.sh"
>> 86: Test timeout computed to be: 9.99988e+06
>> 86: .........FF
>> 86: ======================================================================
>> 86: FAIL: test_fir_filter_scc_001 (__main__.test_filter)
>> 86: ----------------------------------------------------------------------
>> 86: Traceback (most recent call last):
>> 86:   File "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line
>> 262, in test_fir_filter_scc_001
>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 5)
>> 86:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 86:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places
>> 86:
>> 86: ======================================================================
>> 86: FAIL: test_fir_filter_scc_002 (__main__.test_filter)
>> 86: ----------------------------------------------------------------------
>> 86: Traceback (most recent call last):
>> 86: Using Volk machine: avx_32_mmx
>> 86:   File "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line
>> 281, in test_fir_filter_scc_002
>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 5)
>> 86:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 86:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places
>> 86:
>> 86: ----------------------------------------------------------------------
>> 86: Ran 11 tests in 0.035s
>> 86:
>> 86: FAILED (failures=2)
>> 1/1 Test #86: qa_fir_filter ....................***Failed    0.30 sec
>>
>> 0% tests passed, 1 tests failed out of 1
>>
>> Total Test time (real) =   0.31 sec
>>
>> The following tests FAILED:
>>       86 - qa_fir_filter (Failed)
>> Errors while running CTest
>>
>>
>> 91: Test command: /bin/sh
>> "/home/dave/gnuradio/build/gr-filter/python/qa_freq_xlating_fir_filter_test.sh"
>> 91: Test timeout computed to be: 9.99988e+06
>> 91: ........FFFF
>> 91: ======================================================================
>> 91: FAIL: test_fir_filter_scc_001 (__main__.test_freq_xlating_filter)
>> 91: ----------------------------------------------------------------------
>> 91: Traceback (most recent call last):
>> 91:   File
>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line
>> 412, in test_fir_filter_scc_001
>> 91:     self.assertComplexTuplesAlmostEqual(expected_data,
>> result_data[-20:], 5)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 91: AssertionError: (-0.00775564694777+0.0437113791704j) != (nan+nanj)
>> within 5 places
>> 91:
>> 91: ======================================================================
>> 91: Using Volk machine: avx_32_mmx
>> 91: FAIL: test_fir_filter_scc_002 (__main__.test_freq_xlating_filter)
>> 91: ----------------------------------------------------------------------
>> 91: Traceback (most recent call last):
>> 91:   File
>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line
>> 442, in test_fir_filter_scc_002
>> 91:     self.assertComplexTuplesAlmostEqual(expected_data,
>> result_data[-20:], 5)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 91: AssertionError: (-0.0080680437386-0.00158522999845j) != (nan+nanj)
>> within 5 places
>> 91:
>> 91: ======================================================================
>> 91: FAIL: test_fir_filter_scf_001 (__main__.test_freq_xlating_filter)
>> 91: ----------------------------------------------------------------------
>> 91: Traceback (most recent call last):
>> 91:   File
>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line
>> 352, in test_fir_filter_scf_001
>> 91:     self.assertComplexTuplesAlmostEqual(expected_data,
>> result_data[-20:], 5)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 91: AssertionError: (-0.0330070219934+0.101965591311j) != (nan+nanj) within
>> 5 places
>> 91:
>> 91: ======================================================================
>> 91: FAIL: test_fir_filter_scf_002 (__main__.test_freq_xlating_filter)
>> 91: ----------------------------------------------------------------------
>> 91: Traceback (most recent call last):
>> 91:   File
>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line
>> 382, in test_fir_filter_scf_002
>> 91:     self.assertComplexTuplesAlmostEqual(expected_data,
>> result_data[-20:], 5)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 74, in assertComplexTuplesAlmostEqual
>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg)
>> 91:   File
>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line
>> 47, in assertComplexAlmostEqual
>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places`
>> ))
>> 91: AssertionError: (0.00824625696987-1.50158575707e-05j) != (nan+nanj)
>> within 5 places
>> 91:
>> 91: ----------------------------------------------------------------------
>> 91: Ran 12 tests in 0.045s
>> 91:
>> 91: FAILED (failures=4)
>> 1/1 Test #91: qa_freq_xlating_fir_filter .......***Failed    0.32 sec
>>
>> 0% tests passed, 1 tests failed out of 1
>>
>> Total Test time (real) =   0.34 sec
>>
>> The following tests FAILED:
>>       91 - qa_freq_xlating_fir_filter (Failed)
>> Errors while running CTest
>>
>>
>> 150: Test command: /bin/sh
>> "/home/dave/gnuradio/build/gr-digital/python/qa_constellation_receiver_test.sh"
>> 150: Test timeout computed to be: 9.99988e+06
>> 150: Segmentation fault (core dumped)
>> 1/1 Test #150: qa_constellation_receiver ........***Failed   13.64 sec
>>
>> 0% tests passed, 1 tests failed out of 1
>>
>> Total Test time (real) =  13.66 sec
>>
>> The following tests FAILED:
>>      150 - qa_constellation_receiver (Failed)
>> Errors while running CTest
>>
>>
>> 169: Test command: /bin/sh
>> "/home/dave/gnuradio/build/gr-vocoder/python/qa_codec2_vocoder_test.sh"
>> 169: Test timeout computed to be: 9.99988e+06
>> 169: F
>> 169: ======================================================================
>> 169: FAIL: test001_module_load (__main__.test_codec2_vocoder)
>> 169: ----------------------------------------------------------------------
>> 169: Traceback (most recent call last):
>> 169:   File "/home/dave/gnuradio/gr-vocoder/python/qa_codec2_vocoder.py",
>> line 56, in test001_module_load
>> 169:     self.assertEqual(expected_data, actual_result)
>> 169: AssertionError: Tuples differ: (0, 0, 0, 3, 2, 0, 1, 5, 6, 7,... !=
>> (0L, 0L, 0L, 3L, 2L, 0L, 1L, 5...
>> 169:
>> 169: First differing element 112:
>> 169: 24
>> 169: 25
>> 169:
>> 169: Diff is 3978 characters long. Set self.maxDiff to None to see it.
>> 169:
>> 169: ----------------------------------------------------------------------
>> 169: Ran 1 test in 0.503s
>> 169:
>> 169: FAILED (failures=1)
>> 1/1 Test #169: qa_codec2_vocoder ................***Failed    0.86 sec
>>
>> 0% tests passed, 1 tests failed out of 1
>>
>> Total Test time (real) =   0.87 sec
>>
>> The following tests FAILED:
>>      169 - qa_codec2_vocoder (Failed)
>> Errors while running CTest
>>
>>
>>
>> I've rerun apt-get on for the following, and all report back as being the
>> most current release:
>> python-dev
>> python-wxgtk2.8
>> python-numpy
>> python-cheetah
>> python-lxml
>> python-qt4
>> python-qwt5-qt4
>>
>> Any help you can offer would be very much appreciated.
>> libqt4-opengl-dev libqwt5-qt4-dev libfontconfig1-dev libxrender-dev
> 
> Dave,
> 
> Thanks for the details in your question. The first three look like
> Volk issues and the last looks like a precision error.
> 
> What is the computer hardware? Specifically, what processor, processor
> architecture (32 or 64 bit), and are your running it in a VM?
> 
> Tom
> 
> 
> 
> _______________________________________________
> Discuss-gnuradio mailing list
> address@hidden
> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>