[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[automake-commit] 04/04: tests: protect against parallel false failure

From: Jim Meyering
Subject: [automake-commit] 04/04: tests: protect against parallel false failure
Date: Sun, 15 Nov 2020 12:46:32 -0500

meyering pushed a commit to branch master
in repository automake.

View the commit online:;a=commitdiff;h=26ef6e7f3cfc603fe8e303d3cfa202a1334415c4

commit 26ef6e7f3cfc603fe8e303d3cfa202a1334415c4
Author: Jim Meyering <>
AuthorDate: Sun Nov 15 09:00:37 2020 -0800

    tests: protect against parallel false failure
    * t/ Do not depend on the order
    of items in test summary. With a parallel test run, they may
    appear in a different order, e.g., when running tests like this:
      make check AM_TESTSUITE_MAKE='make -j14'
    Sort the expected output and the actual output before comparing.
 t/ | 10 +++++-----
 1 file changed, 5 insertions(+), 5 deletions(-)

diff --git a/t/ 
index 66bf89d..df660a1 100644
--- a/t/
+++ b/t/
@@ -34,13 +34,13 @@ a/b/skip.log: sub/error2.log
 cat > exp <<'END'
-FAIL: fail.test
-PASS: pass.test
 ERROR: error.test
-XPASS: sub/xpass.test
-XFAIL: xfail.test
 ERROR: sub/error2.test
+FAIL: fail.test
+PASS: pass.test
 SKIP: a/b/skip.test
+XFAIL: xfail.test
+XPASS: sub/xpass.test
 mkdir sub a a/b
@@ -93,7 +93,7 @@ for vpath in : false; do
   run_make -O -e FAIL check
-  LC_ALL=C grep '^[A-Z][A-Z]*:' stdout > got
+  LC_ALL=C grep '^[A-Z][A-Z]*:' stdout | sort > got
   cat got
   diff $srcdir/exp got
   cd $srcdir

reply via email to

[Prev in Thread] Current Thread [Next in Thread]