Kahip with python

[magniolia92]

I wantto use Kahip with python.
I build the project with ./compile_withcmake.sh BUILDPYTHONMODULE and got the following:

$ ./compile_withcmake.sh BUILDPYTHONMODULE
-- Building for: Visual Studio 17 2022
-- The C compiler identification is MSVC 19.34.31937.0
-- The CXX compiler identification is MSVC 19.34.31937.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.34.31933/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.34.31933/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test COMPILER_SUPPORTS_FUNROLL_LOOPS
-- Performing Test COMPILER_SUPPORTS_FUNROLL_LOOPS - Failed
-- Performing Test COMPILER_SUPPORTS_FNOSTACKLIMITS
-- Performing Test COMPILER_SUPPORTS_FNOSTACKLIMITS - Failed
-- Performing Test COMPILER_SUPPORTS_WALL
-- Performing Test COMPILER_SUPPORTS_WALL - Success
-- Performing Test COMPILER_SUPPORTS_MARCH_NATIVE
-- Performing Test COMPILER_SUPPORTS_MARCH_NATIVE - Failed
-- Performing Test COMPILER_SUPPORTS_FPERMISSIVE
-- Performing Test COMPILER_SUPPORTS_FPERMISSIVE - Failed
-- Performing Test COMPILER_SUPPORTS_UNUSED
-- Performing Test COMPILER_SUPPORTS_UNUSED - Failed
-- Performing Test COMPILER_SUPPORTS_NOSIGNCOMP
-- Performing Test COMPILER_SUPPORTS_NOSIGNCOMP - Failed
-- Found MPI_C: C:/Program Files/MPICH2/lib/mpi.lib (found version "2.2")
-- Found MPI_CXX: C:/Program Files/MPICH2/lib/mpi.lib (found version "2.2")
-- Found MPI: TRUE (found version "2.2")
-- Found OpenMP_C: -openmp (found version "2.0")
-- Found OpenMP_CXX: -openmp (found version "2.0")
-- Found OpenMP: TRUE (found version "2.0")
-- OpenMP support detected
-- pybind11 v2.6.2 dev1
-- Found PythonInterp: C:/Program Files/Python39/python.exe (found version "3.9.10")
-- Found PythonLibs: C:/Program Files/Python39/libs/python39.lib
-- Performing Test HAS_MSVC_GL_LTCG
-- Performing Test HAS_MSVC_GL_LTCG - Success
-- Configuring done
-- Generating done
-- Build files have been written to: C:/Users/manel/KaHIP/build
make: *** Pas de cibles sp▒cifi▒es et aucun makefile n'a ▒t▒ trouv▒. Arr▒t.

Copying files into 'deploy'

... executables (serial)
cp: cannot stat './build/edge_partitioning': No such file or directory
cp: cannot stat './build/evaluator': No such file or directory
cp: cannot stat './build/global_multisection': No such file or directory
cp: cannot stat './build/graphchecker': No such file or directory
cp: cannot stat './build/kaffpa': No such file or directory
cp: cannot stat './build/kaffpaE': No such file or directory
cp: cannot stat './build/label_propagation': No such file or directory
cp: cannot stat './build/node_ordering': No such file or directory
cp: cannot stat './build/node_separator': No such file or directory
cp: cannot stat './build/partition_to_vertex_separator': No such file or directory
... libraries (serial)
mv: cannot stat './build/libkahip_static.a': No such file or directory
cp: cannot stat './build/libkahip*': No such file or directory
... headers (serial)

... executables (parallel)
cp: target './deploy/distributed_edge_partitioning' is not a directory
cp: target './deploy/parhip' is not a directory
... libraries (parallel)
cp: cannot stat './build/parallel/parallel_src/libparhip_inter*.a': No such file or directory
cp: cannot stat './build/parallel/modified_kahip/lib*.a': No such file or directory
... headers (parallel)
cp: cannot stat './build/kahip.cp*': No such file or directory

Created files in deploy/
=========================
callkahipfrompython.py                 kaHIP_interface.h
graph2binary.vcxproj                   parallel/
graph2binary.vcxproj.filters           parhip_interface.h
graph2binary_external.vcxproj          toolbox.vcxproj
graph2binary_external.vcxproj.filters  toolbox.vcxproj.filters
=========================

Can remove old build directory

what should I modify in ./compile_withcmake.sh file in order to have kahip with python ?
Thank you

[DanielSeemaier]

The build script expects CMake to generate a Makefile. In your case, CMake does not generate a Makefile, but (presumably?) project files for Visual Studio. You could try letting CMake invoke the native build system by running cmake --build "C:/Users/manel/KaHIP/build/".

If there are compile errors due to MSCV, your best bet would probably be to use a Unix toolchain with gcc or clang to build KaHIP (i.e., mingw or WLS).

[magniolia92]

Thank you for your answer. Indeed, I tried to generate the project with MinGW Makefiles and the result is as follows:

The C compiler identification is GNU 9.2.0
The CXX compiler identification is GNU 9.2.0
Detecting C compiler ABI info
Detecting C compiler ABI info - done
Check for working C compiler: C:/MinGW/bin/gcc.exe - skipped
Detecting C compile features
Detecting C compile features - done
Detecting CXX compiler ABI info
Detecting CXX compiler ABI info - done
Check for working CXX compiler: C:/MinGW/bin/c++.exe - skipped
Detecting CXX compile features
Detecting CXX compile features - done
Performing Test COMPILER_SUPPORTS_FUNROLL_LOOPS
Performing Test COMPILER_SUPPORTS_FUNROLL_LOOPS - Success
Performing Test COMPILER_SUPPORTS_FNOSTACKLIMITS
Performing Test COMPILER_SUPPORTS_FNOSTACKLIMITS - Success
Performing Test COMPILER_SUPPORTS_WALL
Performing Test COMPILER_SUPPORTS_WALL - Success
Performing Test COMPILER_SUPPORTS_MARCH_NATIVE
Performing Test COMPILER_SUPPORTS_MARCH_NATIVE - Success
Performing Test COMPILER_SUPPORTS_FPERMISSIVE
Performing Test COMPILER_SUPPORTS_FPERMISSIVE - Success
Performing Test COMPILER_SUPPORTS_UNUSED
Performing Test COMPILER_SUPPORTS_UNUSED - Success
Performing Test COMPILER_SUPPORTS_NOSIGNCOMP
Performing Test COMPILER_SUPPORTS_NOSIGNCOMP - Success
Could NOT find MPI_C (missing: MPI_C_WORKS) 
Could NOT find MPI_CXX (missing: MPI_CXX_WORKS) 
CMake Error at C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find MPI (missing: MPI_C_FOUND MPI_CXX_FOUND)
Call Stack (most recent call first):
  C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
  C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindMPI.cmake:1837 (find_package_handle_standard_args)
  CMakeLists.txt:65 (find_package)


Configuring incomplete, errors occurred!
See also "C:/Users/manel/KaHIP/build/CMakeFiles/CMakeOutput.log".
See also "C:/Users/manel/KaHIP/build/CMakeFiles/CMakeError.log".

I am using MPICH2

[DanielSeemaier]

KaHIP uses the FindMPI module to find the MPI library and it seems to be unable to do so on your system. You could try pointing CMake to the right directory by passing -DMPI_HOME=/path/to/mpich(see [1]).

What happens if you run CMake on this minimal CMakeLists.txt? Do you get the same error message?

cmake_minimum_required(VERSION 3.16)
project(Foo CXX)
find_package(MPI REQUIRED)

[1] https://cmake.org/cmake/help/latest/module/FindMPI.html#variables-for-locating-mpi

[magniolia92]

you are right, he cannot find the MPI even with the minimal code you have proposed :

>>>> cmake CMakeLists.txt -G "MinGW Makefiles"

-- The CXX compiler identification is GNU 9.2.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/MinGW/bin/c++.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Could NOT find MPI_CXX (missing: MPI_CXX_WORKS)
CMake Error at C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find MPI (missing: MPI_CXX_FOUND)
Call Stack (most recent call first):
  C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
  C:/Program Files/cmake-3.25.1-windows-x86_64/share/cmake-3.25/Modules/FindMPI.cmake:1837 (find_package_handle_standard_args)
  CMakeLists.txt:3 (find_package)


-- Configuring incomplete, errors occurred!

I tried to add the MPI_HOME to the environment variable but same error occurs ..
should I use another MPI to build the code ? do you have any propositions khowing that I am using windows ?

[DanielSeemaier]

unfortunately I don't have any experience with Windows .. maybe try OpenMPI?

Btw. if you have a somewhat recent CMake version installed (>= 3.17), you can run it with --debug-find to get more insights into why it cannot find the library; maybe that will help you to figure out what's going wrong