SEER is an online tool for evaluating the performance of seven Time Series Database Systems (TSDBs) using a mixed set of workloads. The tool builds upon our TSM-Bench benchmark TSM-Bench: Benchmarking Time Series Database Systems for Monitoring Applications, PVLDB'23. SEER implements an end-to-end pipeline for database benchmarking, from data generation and workload evaluation to feature contamination. Technical details can be found in the paper SEER: An End-to-End Toolkit for Benchmarking Time Series Database Systems in Monitoring Applications, PVLDB'24
- List of benchmarked systems: ClickHouse, Druid, eXtremeDB*, InfluxDB, MonetDB, QuestDB, TimescaleDB.
- SEER evaluates time series generation, offline/online query performance, and the impact of time series features on storage.
- SEER uses various hydrological datasets provided by the Swiss Federal Office for the Environment (FOEN). The evaluated datasets can be found here.
- *Note: Due to license restrictions, we can only share the evaluation version of extremeDB.
SEER was created at the eXascale Infolab, a research group at the University of Fribourg, Switzerland, under the direction of Dr. Mourad Khayati.
- Ubuntu 20 (including Ubuntu derivatives, e.g., Xubuntu)
- Clone this repository
- Install Docker and Docker-Compose (if not already installed)
sh setup/install_docker.sh
- Build the app and start it
docker-compose up -d --build
- Initialize the tool with offline and online results
sh setup/init_seer.sh
sh setup/migrate_query_data.sh
- You can access it by opening https://localhost:12007 in your browser. If the tool does not launch, please review the docker installation
- Luca Althaus
- Mourad Khayati ([email protected])
- Abdelouahab Khelifati