Skip to content
/ zn-perf Public

Apache Parquet search performance experiments

Notifications You must be signed in to change notification settings

vvv/zn-perf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

55 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

How to build

# Enable all features supported by the current CPU:
RUSTFLAGS='-C target-cpu=native' cargo build --release

To see the features enabled by this RUSTFLAGS value, type

diff -u <(rustc --print cfg) <(rustc -C target-cpu=native --print cfg)

See also https://crates.io/crates/arrow#performance-tips

How to run benchmarks

Specify the path to parquet file via FILE environment variable, e.g.

FILE=dat/7013506939548213248.parquet \
RUSTFLAGS='-C target-cpu=native' \
cargo bench

How to obtain parquet files

  1. Ask someone nicely 😉
  2. Generate a parquet file with tustvold/access-log-gen

About

Apache Parquet search performance experiments

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published