MantisBT - CMake
View Issue Details
IDProjectCategoryView StatusDate SubmittedLast Update
0014145CMake(No Category)public2013-05-15 21:502016-06-10 14:31
ReporterHo Cheung 
Assigned ToKitware Robot 
PrioritynormalSeverityminorReproducibilityalways
StatusclosedResolutionmoved 
PlatformVS2012OSWindowsOS VersionWindows 7
Product VersionCMake 2.8.10.2 
Target VersionFixed in Version 
Summary0014145: CMake generated solutions don't build projects in parallel with VS "Batch Build"
DescriptionThe project-level parallelism available via the Tools -> Options -> Projects and Solutions -> Build And Run appears to be non-functional. The output window will show the solution being build sequentially one project at a time despite no dependencies between many projects. Task manager shows many MSBuild.exe processes but only 1 cl.exe going.

This is especially annoying when building projects with hundreds of target like ITK with tests on. It will literally take 3 hours on a very fast 12-thread machine whereas the same compile under gcc will be done in under 15 minutes.
Steps To ReproduceRun CMake on ITK source with default settings.

Click on Build -> Batch Build -> Select ALL_BUILD for any configuration you want (or all of them, it makes no difference) -> Build.

Observe that only 1 project is being build at a time.
Additional Information
TagsNo tags attached.
Relationships
Attached Files
Issue History
Date ModifiedUsernameFieldChange
2013-05-15 21:50Ho CheungNew Issue
2013-05-16 12:00Brad KingNote Added: 0033062
2013-05-16 12:03Ho CheungNote Added: 0033063
2013-05-16 12:04Ho CheungNote Edited: 0033063bug_revision_view_page.php?bugnote_id=33063#r1159
2013-05-16 12:05Ho CheungNote Edited: 0033063bug_revision_view_page.php?bugnote_id=33063#r1160
2013-05-16 12:19Ho CheungNote Added: 0033064
2013-05-16 12:52Brad KingNote Added: 0033066
2013-05-16 12:53Brad KingNote Added: 0033067
2013-05-16 13:01Ho CheungNote Added: 0033069
2013-05-16 13:53Brad KingNote Added: 0033072
2013-05-16 13:55Brad KingNote Added: 0033073
2013-05-16 14:07Ho CheungNote Added: 0033075
2013-05-16 14:27Brad KingNote Added: 0033076
2013-05-16 14:27Brad KingStatusnew => backlog
2013-05-16 14:27Brad KingSummaryCMake generated solutions don't build projects in parallel. => CMake generated solutions don't build projects in parallel with VS "Batch Build"
2013-05-16 15:07Ho CheungNote Added: 0033079
2016-06-10 14:28Kitware RobotNote Added: 0042280
2016-06-10 14:28Kitware RobotStatusbacklog => resolved
2016-06-10 14:28Kitware RobotResolutionopen => moved
2016-06-10 14:28Kitware RobotAssigned To => Kitware Robot
2016-06-10 14:31Kitware RobotStatusresolved => closed

Notes
(0033062)
Brad King   
2013-05-16 12:00   
Add the /MP option to your CMAKE_C_FLAGS and CMAKE_CXX_FLAGS:

 http://msdn.microsoft.com/en-us/library/vstudio/bb385193.aspx [^]
(0033063)
Ho Cheung   
2013-05-16 12:03   
(edited on: 2013-05-16 12:05)
That only enables object-level parallelism. (ie. Multiple cxx files in each project can be compiled in parallel). The targets themselves still will not build in parallel.

http://www.kitware.com/blog/home/post/434 [^]
http://msdn.microsoft.com/en-us/library/vstudio/bb651793.aspx [^]

Edit: The ITK project itself has hundreds of these single-file targets (most of them being tests), thus the /MP option only minimally improves the situation.
(0033064)
Ho Cheung   
2013-05-16 12:19   
Here is an example of the expected output (note the first 2 lines, and how the subsequent lines have interleaving IDs).

http://msdn.microsoft.com/en-us/library/9h3z1a69(v=vs.90).aspx [^]

Last time I checked, this worked correctly in VS9 with CMake, but has since stopped working in VS11.
(0033066)
Brad King   
2013-05-16 12:52   
I regularly build CMake-generated projects in VS 10 and 11 and it always builds several targets in parallel.
(0033067)
Brad King   
2013-05-16 12:53   
Are you using the professional or express edition of VS? What is the value of CMAKE_MAKE_PROGRAM in CMakeCache.txt?
(0033069)
Ho Cheung   
2013-05-16 13:01   
From Help->About

Microsoft Visual Studio Ultimate 2012
Version 11.0.51106.01 Update 1

Behavior is the same both on my laptop and desktop, as well as several clean virtual machines I run.

CMAKE_MAKE_PROGRAM is C:/PROGRA~2/MICROS~3.0/Common7/IDE/devenv.com

If you look at your output window, do you see the interleaved build output?
(0033072)
Brad King   
2013-05-16 13:53   
Using version:

 Microsoft Visual Studio Professional 2012
 Version 11.0.60315.01 Update 2

I just configured ITK with the "Visual Studio 11 Win64" generator, loaded it in the IDE, right-clicked on "ALL_BUILD", and chose "Build". The output window has:

2>------ Build started: Project: itkvcl, Configuration: Debug x64 ------
3>------ Build started: Project: itkv3p_netlib, Configuration: Debug x64 ------
4>------ Build started: Project: itkv3p_lsqr, Configuration: Debug x64 ------
5>------ Build started: Project: itkdouble-conversion, Configuration: Debug x64 ------
6>------ Build started: Project: itksys, Configuration: Debug x64 ------
2>Build started 5/16/2013 1:50:09 PM.
7>------ Build started: Project: gdcmCommon, Configuration: Debug x64 ------
8>------ Build started: Project: itkzlib, Configuration: Debug x64 ------
9>------ Build started: Project: ITKEXPAT, Configuration: Debug x64 ------
3>Build started 5/16/2013 1:50:09 PM.
4>Build started 5/16/2013 1:50:09 PM.
6>Build started 5/16/2013 1:50:09 PM.
9>Build started 5/16/2013 1:50:09 PM.

and lots of interleaved compilation output.
(0033073)
Brad King   
2013-05-16 13:55   
Re 0014145:0033072: I used CMake 2.8.11, not 2.8.10.2, but nothing has changed AFAIK.

Also, the IDE configuration

 Tools -> Options -> Projects and Solutions -> Build And Run

is set to "8".
(0033075)
Ho Cheung   
2013-05-16 14:07   
It appears that it is because I'm using the Batch Build feature.

I like to use it to so I can build Debug and Release and then go get a coffee. When you do that, the individual targets do not build in parallel even within the same configuration.
(0033076)
Brad King   
2013-05-16 14:27   
Please propose a specific change to the content of the .sln or .vcxproj files that allows what you want to work. With that we can teach the generator to produce such content.
(0033079)
Ho Cheung   
2013-05-16 15:07   
I'm afraid I'm not sure how the .sln/.vcxproj files work to propose a solution. I was merely reporting what I observed as a unexpected behavior.

It might be that this is actually a bug in Visual Studio's Batch Build feature actually, because when I right-click on ALL_BUILD and select Build, it works as expected.
(0042280)
Kitware Robot   
2016-06-10 14:28   
Resolving issue as `moved`.

This issue tracker is no longer used. Further discussion of this issue may take place in the current CMake Issues page linked in the banner at the top of this page.