Interact, analyze and structure massive text, image, embedding, audio and video datasets

Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)

WinDirStat is a disk usage statistics viewer and cleanup tool for Microsoft Windows

A plugin that does one thing only: Detect and manage duplicate items in Zotero.

Near Duplicate Video Detection (Perceptual Video Hashing) - Get a 64-bit comparable hash-value for any video.

Filter, Sort & Delete Duplicate Files Recursively

⚡ Check your npm modules for unused and duplicate dependencies fast

Interactive code for image similarity using SIFT algorithm

The Panako acoustic fingerprinting system.

CLI utility to find near duplicate images and remove all but the best copy.

Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.

Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:

Find similar audio files easily

CLI tool that fast checks if your bundle contains multiple versions of the same package, only by looking in package.json.

A collection of free-text bug reports for duplicate issue identification

Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.

Duplicates finder for various source code formats.

Detecting near-duplicate videos by aggregating features from intermediate CNN layers

Command-line program for managing a media collection, with focus on Content-Based Image Retrieval (Computer Vision) methods for finding duplicates.

Nextcloud Media Duplicate Collector application