[cmake-developers] [CMake 0015524]: CTestTestSerialOrder test fails if CTEST_PARALLEL_LEVEL > 1

[Mantis Bug Tracker]

The following issue has been SUBMITTED. 
====================================================================== 
http://public.kitware.com/Bug/view.php?id=15524 
====================================================================== 
Reported By:                Stephen Kelly
Assigned To:                
====================================================================== 
Project:                    CMake
Issue ID:                   15524
Category:                   (No Category)
Reproducibility:            have not tried
Severity:                   minor
Priority:                   normal
Status:                     new
====================================================================== 
Date Submitted:             2015-04-21 00:39 CEST
Last Modified:              2015-04-21 00:39 CEST
====================================================================== 
Summary:                    CTestTestSerialOrder test fails if
CTEST_PARALLEL_LEVEL > 1
Description: 
stephen at hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$
rm -rf * 
stephen at hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$
cmake ..
-- The C compiler identification is GNU 4.9.1
-- The CXX compiler identification is GNU 4.9.1
-- Check for working C compiler: /usr/lib/ccache/cc
-- Check for working C compiler: /usr/lib/ccache/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/lib/ccache/c++
-- Check for working CXX compiler: /usr/lib/ccache/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done
-- Generating done
-- Build files have been written to:
/home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
stephen at hal:~/dev/src/cmake-master/Tests/CTestTestSerialOrder/build{deterministic-CTest-tests}$
ctest .
Test project /home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/build
      Start  8: test7a
      Start  9: test7b
      Start  7: test6
      Start  1: initialization
      Start 11: test9
      Start 10: test8
 1/15 Test  http://public.kitware.com/Bug/view.php?id=7: test6
............................   Passed    0.01 sec
 2/15 Test http://public.kitware.com/Bug/view.php?id=10: test8
............................   Passed    0.01 sec
 3/15 Test  http://public.kitware.com/Bug/view.php?id=1: initialization
...................   Passed    0.01 sec
 4/15 Test http://public.kitware.com/Bug/view.php?id=11: test9
............................   Passed    0.01 sec
 5/15 Test  http://public.kitware.com/Bug/view.php?id=9: test7b
...........................   Passed    0.02 sec
 6/15 Test  http://public.kitware.com/Bug/view.php?id=8: test7a
...........................   Passed    0.02 sec
      Start  6: test5
      Start  2: test1
      Start  3: test2
      Start  4: test3
      Start 12: test10
      Start 13: test11
 7/15 Test  http://public.kitware.com/Bug/view.php?id=3: test2
............................   Passed    0.01 sec
 8/15 Test  http://public.kitware.com/Bug/view.php?id=4: test3
............................   Passed    0.01 sec
 9/15 Test http://public.kitware.com/Bug/view.php?id=12: test10
...........................   Passed    0.01 sec
10/15 Test  http://public.kitware.com/Bug/view.php?id=2: test1
............................   Passed    0.02 sec
11/15 Test http://public.kitware.com/Bug/view.php?id=13: test11
...........................   Passed    0.01 sec
12/15 Test  http://public.kitware.com/Bug/view.php?id=6: test5
............................   Passed    0.02 sec
      Start  5: test4
      Start 14: test12
      Start 15: verification
13/15 Test  http://public.kitware.com/Bug/view.php?id=5: test4
............................   Passed    0.01 sec
14/15 Test http://public.kitware.com/Bug/view.php?id=14: test12
...........................   Passed    0.01 sec
15/15 Test http://public.kitware.com/Bug/view.php?id=15: verification
.....................***Failed    0.01 sec
CMake Error at
/home/stephen/dev/src/cmake-master/Tests/CTestTestSerialOrder/test.cmake:25
(message):
  Actual test order
 
[initialization;test9;test8;test5;test2;test1;test3;test10;test11;test4;test12]
  differs from expected test order
 
[initialization;test9;test8;test1;test2;test3;test6;test7a;test7b;test5;test4;test10;test11;test12]




93% tests passed, 1 tests failed out of 15

Total Test time (real) =   0.06 sec

The following tests FAILED:
         15 - verification (Failed)
Errors while running CTest


Additional Information: 
Given that the test is about serial order of test execution, I'm not sure how to
fix this, but adding 

 unset(ENV{CTEST_PARALLEL_LEVEL})
 unset(ENV{CTEST_OUTPUT_ON_FAILURE})

works for me.
====================================================================== 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2015-04-21 00:39 Stephen Kelly  New Issue                                    
======================================================================