[CMake] tests running out of order on cmake

[j s]

On Tue, Jun 28, 2011 at 9:33 AM, Michael Wild <themiwi at gmail.com> wrote:
> If the tests depend on each other, you *must* tell CTest so, by setting
> the DEPENDS property using the set_tests_properties() function.
>
> Normally, running tests in arbitrary order is considered to be a
> feature, helping you to not to introduce accidental dependencies.

I respectfully disagree.  It is a bug, which had been marked as major
severity, as noted by the link in my previous email.  I have 85
regressions, and the first ones run the fastest, so I immediately know
if there is a problem.  Now that I am aware of set_test_properties,
I'll set them for the tests that need them.  When not running tests in
parallel, which is always, they need to run in the exact order
specified.  It is only a feature, if there is a default option like
schedule_sequential, which allows the program to work as I had come to
expect over the past 6 years.

Juan

>
> Michael
>
> On 06/28/2011 04:16 PM, j s wrote:
>> Can someone please let me know how to get the Mac OS X version of
>> cmake 2.8.4 to run the tests in the order in which they are added?
>> For some bizarre reason they are running out of order:
>>
>> Sample output (without actual test name).
>>  1/85 Test #64: XXXXXXXXXXXXXXXX .............***Failed    0.01 sec
>>       Start 63: XXXXXXXXXXXXXXXX
>>  2/85 Test #63: XXXXXXXXXXXXXXXX..............   Passed    0.00 sec
>>       Start 62: XXXXXXXXXXXXXXXX
>>  3/85 Test #62: XXXXXXXXXXXXXXXX..............   Passed    0.00 sec
>>       Start 61: XXXXXXXXXXXXXXXX
>>
>> This is preventing from verifying my recent changes on the mac.  The
>> Ubuntu linux version does not have this issue.
>>
>> Juan
>>
>>
>> On Sat, Jun 25, 2011 at 2:51 PM, j s <j.s4403 at gmail.com> wrote:
>>> Unfortunately the problem came back.  I there a command line option to
>>> fix this out of order execution feature.
>>>
>>> Juan
>>>
>>> On Sat, Jun 25, 2011 at 1:30 PM, j s <j.s4403 at gmail.com> wrote:
>>>> I was able to update the cmake dmg from the website, and now my tests
>>>> are running in the proper order.
>>>>
>>>> On Sat, Jun 25, 2011 at 1:23 PM, j s <j.s4403 at gmail.com> wrote:
>>>>> How do I tell the macports version of cmake 2.8.1  on the mac to run
>>>>> the tests in exactly the order they were originally specified?  I'm in
>>>>> the process of updating macports right now to see if it goes back to
>>>>> the sequential default in later versions?  man ctest reveals
>>>>> --schedule-random, but no sequential option.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Juan
>>>>>
>>>>
>>>
>
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ
>
> Follow this link to subscribe/unsubscribe:
> http://www.cmake.org/mailman/listinfo/cmake
>