CppBenchmarks

A collection of some benchmark scripts I used for C++.

The CMakeLists.txt will add some conan dependencies (such as Google Benchmark library), and do some other magic (enable ccache, etc).

Tested with:

GCC 10.1.0
cmake 3.19.2
conan 1.32.1

One executable will be made for each cpp file that starts with bench: bench_<name>.cpp will create a build/Products/<name> executable.

As usual, you can pass options to the executable:

Using conan >= 2.0:

Install conan dependencies and create toolchain file.

conan install . --output-folder=./build --build=missing -c tools.cmake.cmaketoolchain:generator=Ninja -s compiler.cppstd=20 -s build_type=Release

Build using conan-presets

cmake --preset conan-release
cmake --build --preset conan-release

Alternatively, build explicitly.

cd build/
. ./conanbuild.sh
cmake -G Ninja -DCMAKE_TOOLCHAIN_FILE=conan_toolchain.cmake -DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=ON ../
ninja

Usage:

./Products/bench_basics --benchmark_out=results.csv --benchmark_out_format=csv

./Products/bench_basics --help
benchmark [--benchmark_list_tests={true|false}]
          [--benchmark_filter=<regex>]
          [--benchmark_min_time=<min_time>]
          [--benchmark_repetitions=<num_repetitions>]
          [--benchmark_report_aggregates_only={true|false}]
          [--benchmark_display_aggregates_only={true|false}]
          [--benchmark_format=<console|json|csv>]
          [--benchmark_out=<filename>]
          [--benchmark_out_format=<json|console|csv>]
          [--benchmark_color={auto|true|false}]
          [--benchmark_counters_tabular={true|false}]
          [--v=<verbosity>]

Python CLI to plot results

A small utility to run a specific benchmark executable and plot a bar chart of the results.

See embedded help via python plot_results.py --help

# List available benchmark executables. You should have built the project first!
(py39)julien@CppBenchmarks (main %>)$ python plot_results.py -l

The following benchmark executables are available:
* bench_IdfObject_print
* bench_basics

# Run benchmark and see results
(py39)julien@CppBenchmarks (main +>)$ python plot_results.py bench_IdfObject_print

2021-01-15T14:50:06+01:00
Running /home/julien/Software/CppBenchmarks/build/Products/bench_IdfObject_print
Run on (12 X 4100 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x6)
  L1 Instruction 32 KiB (x6)
  L2 Unified 256 KiB (x6)
  L3 Unified 9216 KiB (x1)
Load Average: 1.24, 1.25, 1.16
***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead.
-------------------------------------------------------------
Benchmark                   Time             CPU   Iterations
-------------------------------------------------------------
BM_OutputN             191084 ns       153003 ns         4517
BM_OutputEndl         1925007 ns      1874790 ns          372
BM_BoostOutputN        195299 ns       155654 ns         4459
BM_BoostOutputEndl    2030197 ns      1980846 ns          358

A matplotlib window will pop up with the graph:

Alternatively, pass --stacked:

(py39)julien@CppBenchmarks (main +>)$ python plot_results.py --stacked bench_IdfObject_print

Name		Name	Last commit message	Last commit date
Latest commit History 66 Commits
cmake		cmake
images		images
resources		resources
test		test
.clang-format		.clang-format
.clang-tidy		.clang-tidy
.gitignore		.gitignore
BCLFileReference.cpp		BCLFileReference.cpp
BCLFileReference.hpp		BCLFileReference.hpp
Benchmark_analysis_Complexity.ipynb		Benchmark_analysis_Complexity.ipynb
CMakeLists.txt		CMakeLists.txt
IddEnums.hpp		IddEnums.hpp
IddEnums_constexpr.hpp		IddEnums_constexpr.hpp
IddEnums_constexpr_test.cpp		IddEnums_constexpr_test.cpp
LICENSE		LICENSE
README.md		README.md
TestClass.cpp		TestClass.cpp
TestClass.hpp		TestClass.hpp
bench_Checksum.cpp		bench_Checksum.cpp
bench_EPWStrings.cpp		bench_EPWStrings.cpp
bench_EnumMap.cpp		bench_EnumMap.cpp
bench_EnumMapOfMap.cpp		bench_EnumMapOfMap.cpp
bench_IdfObject_print.cpp		bench_IdfObject_print.cpp
bench_OpenMP.cpp		bench_OpenMP.cpp
bench_PassStringVal_vs_Ref.cpp		bench_PassStringVal_vs_Ref.cpp
bench_Regex.cpp		bench_Regex.cpp
bench_ThreadPool.cpp		bench_ThreadPool.cpp
bench_Vector3d_eplus.cpp		bench_Vector3d_eplus.cpp
bench_array_2_doubles.cpp		bench_array_2_doubles.cpp
bench_basics.cpp		bench_basics.cpp
bench_byref_pod.cpp		bench_byref_pod.cpp
bench_clipline.cpp		bench_clipline.cpp
bench_constexpr_map.cpp		bench_constexpr_map.cpp
bench_constexpr_map_with_fieldName_cache.cpp		bench_constexpr_map_with_fieldName_cache.cpp
bench_embedded.cpp		bench_embedded.cpp
bench_emplace.cpp		bench_emplace.cpp
bench_emplace2.cpp		bench_emplace2.cpp
bench_emplace3.cpp		bench_emplace3.cpp
bench_eplus_empty_v_int_vector.cpp		bench_eplus_empty_v_int_vector.cpp
bench_filesystem.cpp		bench_filesystem.cpp
bench_iddFileParsing.cpp		bench_iddFileParsing.cpp
bench_isRegexLike.cpp		bench_isRegexLike.cpp
bench_json.cpp		bench_json.cpp
bench_minmaxx.cpp		bench_minmaxx.cpp
bench_normalizeAngle.cpp		bench_normalizeAngle.cpp
bench_optional.cpp		bench_optional.cpp
bench_pod.cpp		bench_pod.cpp
bench_pugixml_byref_by_val.cpp		bench_pugixml_byref_by_val.cpp
bench_replace_string.cpp		bench_replace_string.cpp
bench_shared_ptr.cpp		bench_shared_ptr.cpp
bench_std_function.cpp		bench_std_function.cpp
bench_stl_parallel.cpp		bench_stl_parallel.cpp
bench_stl_parallel2.cpp		bench_stl_parallel2.cpp
bench_string_trim.cpp		bench_string_trim.cpp
bench_struct_2_doubles.cpp		bench_struct_2_doubles.cpp
bench_test_bool_arg.cpp		bench_test_bool_arg.cpp
bench_transform.cpp		bench_transform.cpp
bench_transform_set.cpp		bench_transform_set.cpp
bench_uuid.cpp		bench_uuid.cpp
bench_vecUnique.cpp		bench_vecUnique.cpp
bench_vectorAppend.cpp		bench_vectorAppend.cpp
bench_vectorAppend2.cpp		bench_vectorAppend2.cpp
bench_vectorOfObjects.cpp		bench_vectorOfObjects.cpp
bench_vectors_concat.cpp		bench_vectors_concat.cpp
conanfile.txt		conanfile.txt
plot_results.py		plot_results.py
requirements.txt		requirements.txt
test_regex_replace.cpp		test_regex_replace.cpp

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

CppBenchmarks

Python CLI to plot results

About

Languages

License

jmarrec/CppBenchmarks

Folders and files

Latest commit

History

Repository files navigation

CppBenchmarks

Python CLI to plot results

About

Topics

Resources

License

Stars

Watchers

Forks

Languages