This is an experimental project to build a high performance data store in Rust. The ultimate goal of this project is described in the top-level design document.

Our first plan is to build a storage engine based on the Bw-Tree. Then build a standalone server with the storage engine.

The in-memory part of the storage engine is almost done at the moment. You can check the implementation in the photondb-engine crate.

Some rough benchmarks on the in-memory storage engine so far:

You can run the bench tool with:

cargo build --release
target/release/bench --num-kvs 100000000 --num-ops 30000000 --num-threads 16 --get-weight 4 --put-weight 1

• The Bw-Tree: A B-tree for New Hardware Platforms
• Building a Bw-Tree Takes More Than Just Buzz Words
• Optimizing Bw-tree Indexing Performance
• LLAMA: A Cache/Storage Subsystem for Modern Hardware
• Efficiently Reclaiming Space in a Log Structured Store
• The Design and Implementation of a Log-Structured File System
• TinyLFU: A Highly Efficient Cache Admission Policy