[CMake] Compilation with multiple jobs fails

Steven Bellens steven.bellens at mech.kuleuven.be
Tue Sep 21 03:41:50 EDT 2010 

2010/9/20 Alexander Neundorf <a.neundorf-work at gmx.net>:
> On Monday 20 September 2010, Steven Bellens wrote:
>> Hi,
>>
>> I'm trying to compile a custom library using CMake code. The
>> configuration and compilation goes well when I just use 'make'. In
>> order to speed things up I tried to compile the library with multiple
>> jobs in parallel with 'make -j2'. However, compilation always fails in
>> that case (tested on multiple computers (Fedora - Ubuntu x86_64)). I'm
>> using cmake 2.8.0. I'v emailed this to the developers of the library
>> as well (see emails below). The piece of cmake code involved is
>> indicated below as well, but I'll repeat it here for clarity:
>>
>> The error I get:
>> -----------------------------------------------------------
>> "Generating dyncall-0.3/ConfigVars
>> * configure package dyncall
>> guess operating system linux
>> guess arch x64
>> guess tool gcc
>> guess assembler as
>> [  2%] Generating dyncall/lib/libdyncall_s.a, dyncall/lib/libdynload_s.a
>> make[3]: Leaving directory
>> `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_tool
>>chain_ros/typelib/build' make[4]: Entering directory
>> `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_tool
>>chain_ros/typelib/build/build/orocos-toolchain-typelib/bindings/ruby/dyncall
>>-0.3' make[3]: Entering directory
>> `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_tool
>>chain_ros/typelib/build' make[4]: *** read jobs pipe: Is a directory.  Stop.
>> make[4]: *** Waiting for unfinished jobs...."
>> ----------------------------------------------------------------
>>
>> And the corresponding cmake code:
>>
>> -----------------------------------------------------------
>>  ADD_CUSTOM_COMMAND(OUTPUT ${DYNCALL_SOURCE_DIR}/ConfigVars
>>        COMMAND tar xzf ${CMAKE_CURRENT_SOURCE_DIR}/dyncall-0.3.tar.gz
>>        COMMAND cd ${DYNCALL_SOURCE_DIR}
>> && ./configure --prefix=${DYNCALL_INSTALL_DIR}
>>        DEPENDS ${CMAKE_CURRENT_SOURCE_DIR}/dyncall-0.3.tar.gz)
>>
>>    ADD_CUSTOM_COMMAND(OUTPUT ${DYNCALL_LIBRARIES}
>>        COMMAND make "CFLAGS=-O3 -fPIC"
>>        COMMAND make install
>>        DEPENDS ${DYNCALL_SOURCE_DIR}/ConfigVars
>>        WORKING_DIRECTORY ${DYNCALL_SOURCE_DIR})
>>
>>    ADD_CUSTOM_TARGET(dyncall DEPENDS ${DYNCALL_LIBRARIES})
>> -----------------------------------------------------------
>>
>> I'm not that of a cmake expert, but I see that dyncall needs
>> DYNCALL_LIBRARIES, DYNCALL_LIBRARIES depends on ConfigVars,
>> and ConfigVars are created with the custom command
>>
>> Any ideas what goes wrong here?
>>
>> best regards,
>>
>> Steven
>>
>>
>> ---------- Forwarded message ----------
>> From: Leopold Palomo-Avellaneda <leopold.palomo at upc.edu>
>> Date: 2010/9/15
>> Subject: Re: [Orocos-Dev] Typelib compilation with multiple jobs fails
>> To: "orocos-dev at lists.mech.kuleuven.be" <orocos-dev at lists.mech.kuleuven.be>
>> Cc: Adolfo Rodríguez Tsouroukdissian
>> <adolfo.rodriguez at pal-robotics.com>, Steven Bellens
>> <Steven.Bellens at mech.kuleuven.be>
>>
>> A Dimecres 15 Setembre 2010, Adolfo Rodríguez Tsouroukdissian va escriure:
>> > On Wed, Sep 15, 2010 at 10:55 AM, Steven Bellens <
>> >
>> > steven.bellens at mech.kuleuven.be> wrote:
>> > > 2010/9/14 Peter Soetens <peter at thesourceworks.com>:
>> > > > On Tuesday 14 September 2010 11:08:01 Steven Bellens wrote:
>> > > >> Hi,
>> > > >>
>> > > >> compiling the typelib package with multiple jobs fails:
>> > > >>
>> > > >> cd build && make -j2
>> > > >> make[1]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[2]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[3]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[3]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' Scanning dependencies of target dyncall
>> > > >> Scanning dependencies of target typeLib
>> > > >> make[3]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[3]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' [  0%] Generating dyncall-0.3/ConfigVars
>> > > >> make[3]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[3]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' [  2%] Building CXX object
>> > > >> build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/regist
>> > > >>ry .o * configure package dyncall
>> > > >> guess operating system linux
>> > > >> guess arch x64
>> > > >> guess tool gcc
>> > > >> guess assembler as
>> > > >> [  2%] Generating dyncall/lib/libdyncall_s.a,
>> > > >> dyncall/lib/libdynload_s.a make[4]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > chain_ros/typelib/build/build/orocos-toolchain-typelib/bindings/ruby/dy
>> > >nc al
>> > >
>> > > >> l-0.3' make[4]: *** read jobs pipe: Is a directory.  Stop.
>> > > >> make[4]: *** Waiting for unfinished jobs....
>> > > >> make[5]: Entering directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > chain_ros/typelib/build/build/orocos-toolchain-typelib/bindings/ruby/dy
>> > >nc al
>> > >
>> > > >> l-0.3/dyncall' make[5]: *** read jobs pipe: Is a directory.  Stop.
>> > > >> make[5]: *** Waiting for unfinished jobs....
>> > > >> make[5]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > chain_ros/typelib/build/build/orocos-toolchain-typelib/bindings/ruby/dy
>> > >nc al
>> > >
>> > > >> l-0.3/dyncall' make[4]: *** [dyncall] Error 2
>> > > >> make[4]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > chain_ros/typelib/build/build/orocos-toolchain-typelib/bindings/ruby/dy
>> > >nc al
>> > >
>> > > >> l-0.3' make[3]: ***
>> > >
>> > > [build/orocos-toolchain-typelib/bindings/ruby/dyncall/lib/libdyncall_s.
>> > >a]
>> > >
>> > > >>  Error 2
>> > > >> make[3]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[2]: ***
>> > >
>> > > [build/orocos-toolchain-typelib/bindings/ruby/CMakeFiles/dyncall.dir/al
>> > >l]
>> > >
>> > > >>  Error 2
>> > > >> make[2]: *** Waiting for unfinished jobs....
>> > > >> [  4%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/typebuild
>> > >er .o
>> > >
>> > > >> [  6%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/typemodel
>> > >.o
>> > >
>> > > >> [  8%] Building CXX object
>> > > >> build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/typena
>> > > >>me .o [ 10%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/typevisit
>> > >or .o
>> > >
>> > > >> [ 12%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/typedispl
>> > >ay .o
>> > >
>> > > >> [ 14%] Building CXX object
>> > > >> build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/export
>> > > >>er .o [ 16%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/pluginman
>> > >ag er
>> > >
>> > > >> .o [ 18%] Building CXX object
>> > > >> build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/value.
>> > > >>o [ 20%] Building CXX object
>> > > >> build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/import
>> > > >>er .o [ 22%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/csvoutput
>> > >.o
>> > >
>> > > >> [ 24%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/endiannes
>> > >s. o
>> > >
>> > > >> [ 26%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/memory_la
>> > >yo ut
>> > >
>> > > >> .o [ 28%] Building CXX object
>> > >
>> > > build/orocos-toolchain-typelib/typelib/CMakeFiles/typeLib.dir/value_ops
>> > >.o
>> > >
>> > > >> Linking CXX shared library ../../../../lib/libtypeLib.so
>> > > >> make[3]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' [ 28%] Built target typeLib
>> > > >> make[2]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make[1]: *** [all] Error 2
>> > > >> make[1]: Leaving directory
>> > >
>> > > `/home/steven/src/svn/cturtle/install/stacks/kul-ros-pkg/stacks/orocos_
>> > >to ol
>> > >
>> > > >> chain_ros/typelib/build' make: *** [all] Error 2
>> > > >>
>> > > >> while compiling it with 'make -j1' always goes fine. Any ideas why
>> > > >> this happens?
>> > > >
>> > > > Looks like a bug in the target definition or names in the cmake
>> > > > files...
>> > >
>> > > Don't
>> > >
>> > > > have a clue...
>> > >
>> > > I've taken a look into the CMake code. The problem is the dyncall
>> > > extension for ruby. The CMakeLists.txt there contains customs commands
>> > > to extract a tar archive and subsequently configure and build it. I
>> > > don't know what exactly happens but the message "make[4]: *** read
>> > > jobs pipe: Is a directory.  Stop." makes me think it tries to build
>> > > the code before extraction is completed.
>> > >
>> > > Without looking at the code, looks like that there might be a missing
>> >
>> > dependency between the untar and build steps. One of the
>> > add_custom_commands signatures has a DEPENDS option [1]. If what you have
>> > is targets, you could get away with add_dependencies(buildTarget
>> > untarTarget) [2]
>>
>> looking on the code, I have found the dependencies in the custom commands.
>>
>> -----------------------------------------------------------
>>  ADD_CUSTOM_COMMAND(OUTPUT ${DYNCALL_SOURCE_DIR}/ConfigVars
>>        COMMAND tar xzf ${CMAKE_CURRENT_SOURCE_DIR}/dyncall-0.3.tar.gz
>>        COMMAND cd ${DYNCALL_SOURCE_DIR}
>> && ./configure --prefix=${DYNCALL_INSTALL_DIR}
>>        DEPENDS ${CMAKE_CURRENT_SOURCE_DIR}/dyncall-0.3.tar.gz)
>
> This one doesn't have a WORKING_DIRECTORY set for the tar xzf call. I would
> assume it is executed in the CMAKE_CURRENT_BINARY_DIR then.
> What are the values of DYNCALL_SOURCE_DIR and DYNCALL_INSTALL_DIR ?

The full CMakeLists.txt can be found here:
http://gitorious.com/orocos-toolchain/typelib/blobs/master/bindings/ruby/CMakeLists.txt

Steven

>
>>    ADD_CUSTOM_COMMAND(OUTPUT ${DYNCALL_LIBRARIES}
>>        COMMAND make "CFLAGS=-O3 -fPIC"
>>        COMMAND make install
>>        DEPENDS ${DYNCALL_SOURCE_DIR}/ConfigVars
>>        WORKING_DIRECTORY ${DYNCALL_SOURCE_DIR})
>>
>>    ADD_CUSTOM_TARGET(dyncall DEPENDS ${DYNCALL_LIBRARIES})
>> -----------------------------------------------------------
>>
>> I understand that to build dyncall needs DYNCALL_LIBRARIES:
>> - DYNCALL_LIBRARIES depends on ConfigVars
>> - and ConfigVars are created with the custom command _after_ tar and after
>> the configure step (configure creates the ConfigVars file)
>>
>>
>> So, I don't see any clear error here. Maybe is a cmake bug ....
>

More information about the CMake mailing list