[CMake] Do any CMake back ends have support for parallel builds that efficiently use clusters?
Alan W. Irwin
irwin at beluga.phys.uvic.ca
Fri Jan 12 07:53:07 EST 2018
On 2018-01-12 13:34+0300 Konstantin Tokarev wrote:
>
>
> 12.01.2018, 12:58, "Alan W. Irwin" <irwin at beluga.phys.uvic.ca>:
>> I am looking into the practicality of using clusters containing ~5
>> cheap ARM 8-core computers (such as the Banana Pi M3) to rapidly build
>> and test software (since even with ccache I am currently spending a
>> lot of my time waiting for tests to complete as I develop my
>> software). Such clusters would give you ~40 cores which is a lot of
>> computer power for ~$500 or so. But, of course, the issue with
>> clusters is how to use them efficiently?
>
> 1. For compilation you often need good single-core performance more
> than parallelism, and I doubt that embedded-grade ARMv8 can provide it
>
> I guess exception is compiling projects written in C which don't have huge
> source files. Still, overhead of passing data between nodes may be
> substanital.
>
> 2. You should probably use icecc or distcc, unless you have MPI as a
> requirement.
Most of the work is run-time tests (configured with
add_custom_command/target) rather than compilations. It have just
discovered that it looks like "distmake" or equivalent is what I need
(see the post I just wrote).
Alan
__________________________
Alan W. Irwin
Astronomical research affiliation with Department of Physics and Astronomy,
University of Victoria (astrowww.phys.uvic.ca).
Programming affiliations with the FreeEOS equation-of-state
implementation for stellar interiors (freeeos.sf.net); the Time
Ephemerides project (timeephem.sf.net); PLplot scientific plotting
software package (plplot.sf.net); the libLASi project
(unifont.org/lasi); the Loads of Linux Links project (loll.sf.net);
and the Linux Brochure Project (lbproject.sf.net).
__________________________
Linux-powered Science
__________________________
More information about the CMake
mailing list