Prometheus Alertmanager

Fast, secure, efficient backup program

Deduplicating archiver with compression and authenticated encryption.

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Find duplicate files

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

A powerful and modular toolkit for record linkage and duplicate detection in Python

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

Коллекция готовых SQL запросов для PostgreSQL по часто возникающим задачам (получение и модификация данных, ускорение запросов, обслуживание БД)

Extremely fast tool to remove duplicates and other lint from your filesystem

Open source project for data preparation of LLM application builders

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Simple, configuration-driven backup software for servers and workstations

RocketMQ消息幂等去重消费者，支持使用MySQL或者Redis做幂等表，开箱即用

Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents

Scalable data pre processing and curation toolkit for LLMs

Config driven, easy backup cli for restic.

rustic - fast, encrypted, and deduplicated backups powered by Rust

A fast high compression read-only file system for Linux, Windows and macOS

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.