[cmake-developers] [CMake 0011877]: ctest runs tests in different order than previous versions of ctest

[Mantis Bug Tracker]

The following issue has been SUBMITTED. 
====================================================================== 
http://public.kitware.com/Bug/view.php?id=11877 
====================================================================== 
Reported By:                David Cole
Assigned To:                David Cole
====================================================================== 
Project:                    CMake
Issue ID:                   11877
Category:                   CTest
Reproducibility:            always
Severity:                   major
Priority:                   normal
Status:                     assigned
Target Version:             CMake 2.8.5
====================================================================== 
Date Submitted:             2011-02-18 11:16 EST
Last Modified:              2011-02-18 11:16 EST
====================================================================== 
Summary:                    ctest runs tests in different order than previous
versions of ctest
Description: 
Running just "ctest" in the build tree produces a different run order of tests
than the simple top-to-bottom ordering used by previous versions.

Also, ctest and "ctest -N" produce different orderings.


Steps to Reproduce: 
Run "ctest -N" and "ctest" in the build tree of a project with more than a
handful of tests. (Say, CMake, with its nearly 200 tests...)

Expected:
- same ordering between "ctest -N" and "ctest"
- same ordering as ctest 2.8.3 and earlier : simple top-to-bottom in-order of
add_test calls from the CMakeLists file

Actual:
- ctest -N order looks correct
- ctest actual run order is torqued

I suspect the change for http://public.kitware.com/Bug/view.php?id=11561
introduced this regression.

====================================================================== 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2011-02-18 11:16 David Cole     New Issue                                    
2011-02-18 11:16 David Cole     Status                   new => assigned     
2011-02-18 11:16 David Cole     Assigned To               => David Cole      
======================================================================