test framework and IRIX

[Bruno Haible]

On IRIX 6.5, coreutils-6.12.29-a16be has many test failures:

FAIL: misc/help-version.log
PASS: misc/invalid-opt.log
FAIL: rm/cycle.log
FAIL: chmod/no-x.log
FAIL: chgrp/basic.log
FAIL: rm/dangling-symlink.log
FAIL: misc/ls-time.log
FAIL: rm/deep-1.log
FAIL: rm/deep-2.log
FAIL: rm/dir-no-w.log
FAIL: rm/dir-nonrecur.log
FAIL: rm/dot-rel.log
FAIL: rm/isatty.log
FAIL: rm/empty-inacc.log
PASS: rm/empty-name.log
FAIL: rm/f-1.log
FAIL: rm/fail-eacces.log
PASS: rm/fail-eperm.log
FAIL: tail-2/assert.log
FAIL: rm/hash.log
FAIL: rm/i-1.log
FAIL: rm/i-never.log
FAIL: rm/i-no-r.log
FAIL: tail-2/infloop-1.log
FAIL: rm/ignorable.log
FAIL: rm/inaccessible.log
FAIL: rm/interactive-always.log
FAIL: rm/interactive-once.log
FAIL: rm/ir-1.log
FAIL: rm/r-1.log
FAIL: rm/r-2.log
FAIL: rm/r-3.log
FAIL: rm/r-4.log
FAIL: rm/readdir-bug.log
FAIL: rm/rm1.log
FAIL: touch/empty-file.log
FAIL: rm/rm2.log
FAIL: rm/rm3.log
FAIL: rm/rm4.log
FAIL: rm/rm5.log
FAIL: rm/sunos-1.log
FAIL: rm/unread2.log
FAIL: rm/unread3.log
PASS: rm/unreadable.log
FAIL: rm/v-slash.log
FAIL: chgrp/default-no-deref.log
FAIL: chgrp/deref.log
FAIL: chgrp/no-x.log
FAIL: chgrp/posix-H.log
FAIL: chgrp/recurse.log
PASS: misc/test.log
FAIL: misc/seq.log
PASS: misc/head.log
PASS: misc/head-elide-tail.log
FAIL: tail-2/tail-n0f.log
PASS: misc/ls-misc.log
PASS: misc/date.log
FAIL: misc/ptx-overrun.log
PASS: misc/xstrtol.log
PASS: misc/od.log
PASS: misc/mktemp.log
FAIL: misc/arch.log
PASS: misc/pr.log
PASS: misc/join.log
PASS: pr/pr-tests.log
FAIL: misc/df-P.log
FAIL: misc/pwd-unreadable-parent.log
FAIL: misc/chcon-fail.log
FAIL: misc/selinux.log
PASS: misc/cut.log
PASS: misc/wc.log
PASS: misc/wc-files0-from.log
FAIL: misc/wc-files0.log
FAIL: misc/cat-proc.log
PASS: misc/base64.log
PASS: misc/basename.log
FAIL: misc/close-stdout.log
FAIL: misc/csplit.log
FAIL: misc/date-sec.log
PASS: misc/dircolors.log
FAIL: misc/df.log
PASS: misc/dirname.log
PASS: misc/expand.log
PASS: misc/expr.log
PASS: misc/factor.log
FAIL: misc/false-status.log
PASS: misc/fmt.log
FAIL: misc/fmt-long-line.log
PASS: misc/fold.log
FAIL: misc/groups-dash.log
FAIL: misc/groups-version.log
FAIL: misc/head-c.log
FAIL: misc/head-pos.log
FAIL: misc/id-context.log
PASS: misc/md5sum.log
PASS: misc/md5sum-newline.log
FAIL: misc/mknod.log
FAIL: misc/nice.log
FAIL: misc/nl.log
FAIL: misc/nohup.log
FAIL: misc/od-N.log
FAIL: misc/od-x8.log
PASS: misc/paste.log
FAIL: misc/pathchk1.log
FAIL: misc/printf.log
PASS: misc/printf-cov.log
FAIL: misc/printf-hex.log
FAIL: misc/printf-surprise.log
FAIL: misc/pwd-long.log
FAIL: misc/readlink-fp-loop.log
FAIL: misc/runcon-no-reorder.log
PASS: misc/sha1sum.log
PASS: misc/sha1sum-vec.log
PASS: misc/sha224sum.log
PASS: misc/sha256sum.log
PASS: misc/sha384sum.log
PASS: misc/sha512sum.log
FAIL: misc/shred-exact.log
FAIL: misc/shred-remove.log
FAIL: misc/shuf.log
PASS: misc/sort.log
FAIL: misc/sort-compress.log
PASS: misc/sort-merge.log
FAIL: misc/sort-rand.log
FAIL: misc/split-a.log
FAIL: misc/split-fail.log
FAIL: misc/split-l.log
FAIL: misc/stat-fmt.log
PASS: misc/stat-printf.log
SKIP: misc/stty.log
SKIP: misc/stty-invalid.log
SKIP: misc/stty-row-col.log
PASS: misc/sum.log
FAIL: misc/sum-sysv.log
PASS: misc/tac.log
FAIL: misc/tac-continue.log
PASS: misc/tail.log
FAIL: misc/tee.log
FAIL: misc/tee-dash.log
PASS: misc/test-diag.log
FAIL: misc/timeout.log
FAIL: misc/timeout-parameters.log
PASS: misc/tr.log
FAIL: misc/truncate-dangling-symlink.log
FAIL: misc/truncate-dir-fail.log
FAIL: misc/truncate-fail-diag.log
FAIL: misc/truncate-fifo.log
FAIL: misc/truncate-no-create-missing.log
FAIL: misc/truncate-overflow.log
FAIL: misc/truncate-parameters.log
FAIL: misc/truncate-relative.log
PASS: misc/tsort.log
SKIP: misc/tty-eof.log
PASS: misc/unexpand.log
PASS: misc/uniq.log
FAIL: chmod/c-option.log
FAIL: chmod/equal-x.log
FAIL: chmod/equals.log
FAIL: chmod/inaccessible.log
FAIL: chmod/octal.log
FAIL: chmod/setgid.log
FAIL: chmod/thru-dangling.log
FAIL: chmod/umask-x.log
FAIL: chmod/usage.log
FAIL: chown/deref.log
FAIL: chown/preserve-root.log
FAIL: chown/separator.log
FAIL: cp/abuse.log
FAIL: cp/acl.log
FAIL: cp/backup-1.log
FAIL: cp/backup-dir.log
FAIL: cp/backup-is-src.log
FAIL: cp/cp-HL.log
FAIL: cp/cp-deref.log
FAIL: cp/cp-i.log
FAIL: cp/cp-mv-backup.log
FAIL: cp/cp-parents.log
FAIL: cp/deref-slink.log
FAIL: cp/dir-rm-dest.log
FAIL: cp/dir-slash.log
FAIL: cp/dir-vs-file.log
FAIL: cp/existing-perm-race.log
FAIL: cp/fail-perm.log
FAIL: cp/file-perm-race.log
FAIL: cp/into-self.log
FAIL: cp/link.log
FAIL: cp/link-no-deref.log
FAIL: cp/link-preserve.log
FAIL: cp/no-deref-link1.log
FAIL: cp/no-deref-link2.log
FAIL: cp/no-deref-link3.log
FAIL: cp/parent-perm.log
FAIL: cp/parent-perm-race.log
FAIL: cp/perm.log
FAIL: cp/preserve-2.log
FAIL: cp/proc-zero-len.log
FAIL: cp/r-vs-symlink.log
FAIL: cp/same-file.log
FAIL: cp/slink-2-slink.log
FAIL: cp/sparse.log
FAIL: cp/special-f.log
FAIL: cp/src-base-dot.log
FAIL: cp/symlink-slash.log
FAIL: cp/thru-dangling.log
FAIL: dd/misc.log
FAIL: dd/not-rewound.log
PASS: dd/skip-seek.log
FAIL: dd/skip-seek2.log
FAIL: dd/unblock-sync.log
FAIL: du/2g.log
FAIL: du/8gb.log
FAIL: du/basic.log
FAIL: du/deref.log
FAIL: du/deref-args.log
FAIL: du/exclude.log
FAIL: du/fd-leak.log
PASS: du/files0-from.log
FAIL: du/hard-link.log
FAIL: du/inacc-dest.log
FAIL: du/inacc-dir.log
FAIL: du/inaccessible-cwd.log
FAIL: du/long-from-unreadable.log
FAIL: du/long-sloop.log
FAIL: du/no-deref.log
FAIL: du/no-x.log
FAIL: du/one-file-system.log
FAIL: du/restore-wd.log
FAIL: du/slash.log
FAIL: du/slink.log
FAIL: du/trailing-slash.log
FAIL: du/two-args.log
FAIL: install/basic-1.log
FAIL: install/create-leading.log
FAIL: install/d-slashdot.log
FAIL: install/trap.log
FAIL: ln/backup-1.log
FAIL: ln/hard-backup.log
FAIL: ln/misc.log
FAIL: ln/sf-1.log
FAIL: ln/target-1.log
FAIL: ls/color-dtype-dir.log
FAIL: ls/dangle.log
FAIL: ls/dired.log
FAIL: ls/file-type.log
FAIL: ls/follow-slink.log
FAIL: ls/infloop.log
FAIL: ls/inode.log
FAIL: ls/m-option.log
FAIL: ls/no-arg.log
FAIL: ls/proc-selinux-segfault.log
FAIL: ls/recursive.log
FAIL: ls/rt-1.log
FAIL: ls/stat-dtype.log
FAIL: ls/stat-failed.log
FAIL: ls/stat-free-symlinks.log
FAIL: ls/stat-vs-dirent.log
FAIL: ls/symlink-slash.log
FAIL: ls/x-option.log
FAIL: mkdir/p-1.log
FAIL: mkdir/p-2.log
FAIL: mkdir/p-3.log
FAIL: mkdir/p-slashdot.log
FAIL: mkdir/p-thru-slink.log
FAIL: mkdir/p-v.log
FAIL: mkdir/parents.log
FAIL: mkdir/perm.log
FAIL: mkdir/selinux.log
FAIL: mkdir/special-1.log
FAIL: mkdir/t-slash.log
FAIL: mv/acl.log
FAIL: mv/atomic.log
FAIL: mv/atomic2.log
FAIL: mv/backup-dir.log
FAIL: mv/backup-is-src.log
FAIL: mv/childproof.log
FAIL: mv/diag.log
FAIL: mv/dir-file.log
FAIL: mv/dir2dir.log
FAIL: mv/dup-source.log
FAIL: mv/force.log
FAIL: mv/hard-2.log
FAIL: mv/hard-3.log
FAIL: mv/hard-4.log
FAIL: mv/hard-link-1.log
FAIL: mv/hard-verbose.log
PASS: mv/i-1.log
FAIL: mv/i-2.log
SKIP: mv/i-3.log
FAIL: mv/i-4.log
FAIL: mv/i-5.log
FAIL: mv/i-link-no.log
FAIL: mv/into-self.log
FAIL: mv/into-self-2.log
FAIL: mv/into-self-3.log
FAIL: mv/into-self-4.log
FAIL: mv/leak-fd.log
FAIL: mv/mv-special-1.log
FAIL: mv/no-target-dir.log
FAIL: mv/part-fail.log
FAIL: mv/part-hardlink.log
FAIL: mv/part-rename.log
FAIL: mv/part-symlink.log
FAIL: mv/partition-perm.log
FAIL: mv/perm-1.log
FAIL: mv/reply-no.log
FAIL: mv/to-symlink.log
FAIL: mv/trailing-slash.log
FAIL: mv/update.log
FAIL: readlink/can-e.log
FAIL: readlink/can-f.log
FAIL: readlink/can-m.log
FAIL: readlink/rl-1.log
FAIL: rmdir/fail-perm.log
FAIL: rmdir/ignore.log
FAIL: rmdir/t-slash.log
FAIL: tail-2/assert-2.log
FAIL: tail-2/big-4gb.log
FAIL: tail-2/proc-ksyms.log
FAIL: tail-2/start-middle.log
FAIL: touch/dangling-symlink.log
FAIL: touch/dir-1.log
FAIL: touch/fail-diag.log
FAIL: touch/fifo.log
FAIL: touch/no-create-missing.log
FAIL: touch/no-rights.log
FAIL: touch/not-owner.log
FAIL: touch/obsolescent.log
FAIL: touch/read-only.log
FAIL: touch/relative.log
FAIL: chown/basic.log
FAIL: cp/cp-a-selinux.log
FAIL: cp/preserve-gid.log
FAIL: cp/special-bits.log
FAIL: ls/nameless-uid.log
FAIL: misc/chcon.log
FAIL: misc/truncate-owned-by-other.log
FAIL: mkdir/writable-under-readonly.log
FAIL: mv/sticky-to-xpart.log
FAIL: rm/fail-2eperm.log
FAIL: rm/no-give-up.log
FAIL: rm/one-file-system.log
FAIL: tail-2/append-only.log
FAIL: touch/now-owned-by-other.log
/bin/sh[28]: $(echo $(for f ... ; done) | grep -c ^SKIP): syntax error
/bin/sh[31]: $(expr $(echo $(for f ... done) | grep -c ^XPASS)): syntax error

Input record `$(expr $(echo $(for ...' too long
Source line number 1
==

==

Cannot open test-suite.log: No such file or directory
make[4]: *** [test-suite.log] Error 1


The first log file's contents:

$ cat tests/touch/obsolescent.log
FAIL: touch/obsolescent.log (exit: 1)
=====================================

+ touch --version
touch (GNU coreutils) 6.12.29-a16be
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Paul Rubin, Arnold Robbins, Jim Kingdon,
David MacKenzie, and Randy Smith.
+ . ./test-lib.sh
+ unset function_test
+ eval function_test() { return 11; }; function_test
+ function_test
+ test 11 != 11
+ test_dir_=$(pwd)
+ this_test=$(this_test_)
+ t_=$(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d --tmp=$(pwd) 
cu-$(this_test_).XXXXXXXXXX)
+ trap st=$?; cleanup_; d=$(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d 
--tmp=$(pwd) cu-$(this_test_).XXXXXXXXXX);
    cd $(pwd) && chmod -R u+rwx "$d" && rm -rf "$d" && exit $st 0
+ trap (exit $?); exit $? 1 2 13 15
+ cd $(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d --tmp=$(pwd) 
cu-$(this_test_).XXXXXXXXXX)
./touch/obsolescent[24]: $(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d 
--tmp=$(pwd) cu-$(this_test_).XXXXXXXXXX):  not found
+ error_ failed to cd to $(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d 
--tmp=$(pwd) cu-$(this_test_).XXXXXXXXXX)
error_: failed to cd to $(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d 
--tmp=$(pwd) cu-$(this_test_).XXXXXXXXXX)
+ st=1
+ cleanup_
+ d=$(/home/haible/coreutils-6.12.29-a16be/src/mktemp -d --tmp=$(pwd) 
cu-$(this_test_).XXXXXXXXXX)
+ cd $(pwd)
./touch/obsolescent[24]: $(pwd):  not found


It seems that the $(...) constructs are not understood by the /bin/sh shell,
and that `...` could be used instead.

Btw, I have a 'bash' in my PATH, but the tests use /bin/sh. config.status has
this:
S["SHELL"]="/bin/sh"
S["POSIX_SHELL"]="/bin/sh"
S["PREFERABLY_POSIX_SHELL"]="/bin/sh"


Bruno