Tests with Heirloom tools (was: [PATCH v2] Overhauled and modularized tests in `instspc.test'.)

[Stefano Lattarini]

BRIEF DESCRIPTION
  Run the instspc tests with Heirloom tools.

DETAILS
 * The environment is mostly clobbered.
 * The locale is strictly set to "C".
 * The heirloom make version used contains the bug worked around by
   Automake commit `v1.11-159-ge7aa360' "Work around a nasty bug
   (segfault) of Solaris make".
 * CONFIG_SHELL is forced to the heirloom shell (very similar to
   Solaris /bin/sh)
 * GNU coreutils, findutils & diffutils are disabled.
 * The `which' and `mktemp' programs are unavailable.
 * Some programs required to build Automake and/or to make a full
   testsuite run are linked into the sandbox; among them are:
     - the programs from Autoconf 2.65 (autoconf, autom4te, autoheader,
       autoupdate, ...)
     - system perl interpreter (should be version 5.10.x)
     - the GCC C, C++, Java and Fortran compilers (version 4.3.3)
     - Libtool version 2.2.8 (should be irrelevant here)
     - GNU binutils (as, ld, ar, ranlib), from system default

OUTCOME
 Two instspec tests failed:
  - instspc-carriageret-build.test
  - instspc-carriageret-install.test
 See attached log for more info.

COMMENTS
 The problematic `^M' (a.k.a. carriage-return) character was exactly
 the one causing the failure of older `instspc.test' with Solaris
 /usr/xpg4/bin/make and heirloom make.  So, this is not a regression.

==============================================
   GNU Automake 1.11a: tests/test-suite.log   
==============================================

2 of 94 tests failed.  

.. contents:: :depth: 2


FAIL: instspc-carriageret-build.test (exit: 1)
==============================================

/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests:/home/stefano/src/test-in-sandbox/sandboxes/linux-bigio/automake/heirloom/basic-bin:/home/stefano/src/test-in-sandbox/sandboxes/linux-bigio/automake/heirloom/extra-bin
=== Running test ../../src_/tests/instspc-carriageret-build.test
+ pwd 
/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir
+ set -e 
+ eval instspc_test_string=${instspc__carriageret} 
instspc_test_string=
+ test x
 = x 
+ mkdir ./
 
+ mkdir sub sub1 
+ cat 
+ : 
+ : 
+ : 
+ : 
+ : 
+ : 
+ cat 
+ cp source.c source2.c 
+ cat 
+ aclocal-1.11a -Werror 
+ autoconf 
+ automake-1.11a --foreign -Werror -Wall -a 
build=
+ pwd 
dest=/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1
+ cd ./
 
+ ../configure --prefix /
-prefix 
checking for a BSD-compatible install... ../install-sh -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ../install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... nawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for ranlib... ranlib
configure: creating ./config.status
config.status: creating Makefile
config.status: executing depfiles commands
+ make 
        gcc -DPACKAGE_NAME=\"instspc-carriageret-build\" 
-DPACKAGE_TARNAME=\"instspc-carriageret-build\" -DPACKAGE_VERSION=\"1.0\" 
-DPACKAGE_STRING=\"instspc-carriageret-build\ 1.0\" -DPACKAGE_BUGREPORT=\"\" 
-DPACKAGE_URL=\"\" -DPACKAGE=\"instspc-carriageret-build\" -DVERSION=\"1.0\" 
-I. -I..      -g -O2 -MT source.o -MD -MP -MF .deps/source.Tpo -c -o source.o 
../source.c
        mv -f .deps/source.Tpo .deps/source.Po
        rm -f sub/libbase.a
        ar cru sub/libbase.a source.o 
        ranlib sub/libbase.a
        rm -f sub/libnobase.a
        ar cru sub/libnobase.a source.o 
        ranlib sub/libnobase.a
        gcc  -g -O2   -o sub/base source.o  
        gcc  -g -O2   -o sub/nobase source.o  
+ make -e test-install-sep 
file=
 
DESTDIR=/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c ../sub/base.sh 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c -m 644  sub/libbase.a 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
 ( cd 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
 && ranlib libbase.a )
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
  ../install-sh -c sub/base 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub/'
 ../install-sh -c ../sub/nobase.sh 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub/'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
 ../install-sh -c -m 644  sub/libnobase.a 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
 ( cd 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
 && ranlib sub/libnobase.a )
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub/'
  ../install-sh -c sub/nobase 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub/'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c -m 644 ../sub/base.dat 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
 ../install-sh -c -m 644 ../sub/base.h 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
 ../install-sh -c -m 644  ../sub/nobase.dat 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
 ../install-sh -c -m 644  ../sub/nobase.h 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/r-prefix/foo/sub'
        test   -f 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-build.dir/sub1/
-prefix/foo/sub/nobase.h'
*** Error code 1 (bu21)
make: fatal error.
exit_status=1
+ set +e 
+ cd /home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests 
+ test 0 != 0 
+ echo instspc-carriageret-build: exit 1 
instspc-carriageret-build: exit 1
+ exit 1 

FAIL: instspc-carriageret-install.test (exit: 1)
================================================

/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests:/home/stefano/src/test-in-sandbox/sandboxes/linux-bigio/automake/heirloom/basic-bin:/home/stefano/src/test-in-sandbox/sandboxes/linux-bigio/automake/heirloom/extra-bin
=== Running test ../../src_/tests/instspc-carriageret-install.test
+ pwd 
/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir
+ set -e 
+ eval instspc_test_string=${instspc__carriageret} 
instspc_test_string=
+ test x
 = x 
+ mkdir ./
 
+ mkdir sub sub1 
+ cat 
+ : 
+ : 
+ : 
+ : 
+ : 
+ : 
+ cat 
+ cp source.c source2.c 
+ cat 
+ aclocal-1.11a -Werror 
+ autoconf 
+ automake-1.11a --foreign -Werror -Wall -a 
build=sub1
+ pwd 
dest=/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
+ cd ./sub1 
+ ../configure --prefix /
-prefix 
checking for a BSD-compatible install... ../install-sh -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ../install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... nawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for ranlib... ranlib
configure: creating ./config.status
config.status: creating Makefile
config.status: executing depfiles commands
+ make 
        gcc -DPACKAGE_NAME=\"instspc-carriageret-install\" 
-DPACKAGE_TARNAME=\"instspc-carriageret-install\" -DPACKAGE_VERSION=\"1.0\" 
-DPACKAGE_STRING=\"instspc-carriageret-install\ 1.0\" -DPACKAGE_BUGREPORT=\"\" 
-DPACKAGE_URL=\"\" -DPACKAGE=\"instspc-carriageret-install\" -DVERSION=\"1.0\" 
-I. -I..      -g -O2 -MT source.o -MD -MP -MF .deps/source.Tpo -c -o source.o 
../source.c
        mv -f .deps/source.Tpo .deps/source.Po
        rm -f sub/libbase.a
        ar cru sub/libbase.a source.o 
        ranlib sub/libbase.a
        rm -f sub/libnobase.a
        ar cru sub/libnobase.a source.o 
        ranlib sub/libnobase.a
        gcc  -g -O2   -o sub/base source.o  
        gcc  -g -O2   -o sub/nobase source.o  
+ make -e test-install-sep 
file=
 
DESTDIR=/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c ../sub/base.sh 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c -m 644  sub/libbase.a 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo'
 ( cd 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo' && ranlib libbase.a )
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
  ../install-sh -c sub/base 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub/'
 ../install-sh -c ../sub/nobase.sh 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub/'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
 ../install-sh -c -m 644  sub/libnobase.a 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
 ( cd 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo' && ranlib sub/libnobase.a )
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub/'
  ../install-sh -c sub/nobase 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub/'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c -m 644 ../sub/base.dat 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
 ../install-sh -c -m 644 ../sub/base.h 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
 ../install-sh -c -m 644  ../sub/nobase.dat 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
        test -z "/r-prefix/foo" || ../install-sh -c -d 
"/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo"
../install-sh -c -d 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
 ../install-sh -c -m 644  ../sub/nobase.h 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/r-prefix/foo/sub'
        test   -f 
'/home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests/instspc-carriageret-install.dir/
/
-prefix/foo/sub/nobase.h'
*** Error code 1 (bu21)
make: fatal error.
exit_status=1
+ set +e 
+ cd /home/stefano/src/automake/instspc-refactor.dir/heirloom.dir/build_/tests 
+ test 0 != 0 
+ echo instspc-carriageret-install: exit 1 
instspc-carriageret-install: exit 1
+ exit 1