Re: Test harness on VMS, running 489 tests, 141 tests failing.

[John E. Malmberg]

On 3/20/2014 7:28 PM, John E. Malmberg wrote:

Current status = 463 tests, 391 passed, 56 failing.

Additional issues so far:
> features/se_explicit: 10/10 pass
   Needed to adjust for VMS syntax.

features/se_implicit: 10/11 pass, 1 failure.  Unknown issue.

features/value: 0/1 pass, 1 failure.  Test does not appear to work on VMS.

misc/bs-nl: 8/20 pass, 8 failures.  The backslash-newline on recipe 
lines is not working on VMS.

options/dash-I  2/3 pass, 1 failure.  recurse not working properly.

options/dash-e  0/1 pass, 1 failure.  No environment override.

options/dash-n  3/6 pass, 3 failures.  "+" handling broken.
                                      MAKEFLAG appears broken.

options/dash-q  5/8 pass, 3 failures.  Non-existent symbol fails,
                                       2 bs-nl failures.

options/eval    2/3 pass, 1 failure.  recurse not working.

options/symlinks skipped.             Symlinks not enabled
                                      VMS 8.3+ supports symbolic links.

options/DEFAULT 0/1 pass, 1 failure.  make invoking make not working
                                      right.

options/INTERMEDIATE 5/8 pass, 3 failures.
                                     "rm" missing from output when
                                      targets cleaned up. Deleted
                                      targets on separate lines.

options/ONESHELL skipped.  Tests all assume a posix shell.

options/SECONDARY 8/12 pass, 4 failures.  "rm" missing as above.

variables/GNUMAKEFLAGS 2/3 pass, 1 failures.  Child failing,
     missing "entering... and leaving dire... messages.

variables/MAKE  0/1 pass, 1 failure.  Missing entering... and leaving...

variables/MAKEFILES 1/2 pass, 1 failure.  Not sure if bug | feature yet.

variables/MAKEFLAGS 2/3 pass, 1 failure.  Looks like child is failing.

variables/MAKELEVEL 0/1 pass, 1 failure.  Environment variables not
                                          exported to children.
variables/MAKE_RESTARTS 2/3 pass, 1 failure.  Missing entering.. etc.

variables/automatic 7/6 pass, 1 failure.  Echo text with "< or <D
                                          fails.

variables/special   1/2 pass, 1 failure.  bs-nl issue.

variables/undefine  3/4 pass, 1 failure.  Undefine of multi-line
                                          define fails.


The next step is to document at least in the readme.vms file the VMS 
specific behaviors that were discovered from running these tests.

Looks like some problems are affecting multiple tests.

Regards,
-John