Repositories tagged with "dedupe"
restic
โFast, secure, efficient backup programโ
dedupe
dedupeio
โ:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.โ
yarn-deduplicate
scinos
โDeduplication tool for yarn.lock filesโ
zingg
zinggAI
โScalable master data management, identity resolution, entity resolution, and deduplication using MLโ
recordlinkage
J535D165
โA powerful and modular toolkit for record linkage and duplicate detection in Pythonโ
bees
Zygo
โBest-Effort Extent-Same, a btrfs dedupe agentโ
duplicut
nil0x42
โRemove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)โ
free-style
blakeembrey
โMake CSS easier and more maintainable by using JavaScriptโ
csvdedupe
โ:id: Command line tool for deduplicating CSV filesโ
dedupe-examples
โ:id: Examples for using the dedupe libraryโ
imgdupes
knjcode
โIdentifying and removing near-duplicate images using perceptual hashing.โ
dupe-krill
kornelski
โA fast file deduplicatorโ
dduper
Lakshmipathi
โFast block-level out-of-band BTRFS deduplication tool.โ
mail-deduplicate
kdeldycke
โ๐ง CLI to deduplicate mails from mail boxesโ
chkbit
laktak
โCheck your files for data corruption and run quick file deduplicationโ
daxus
jason89521
โDaxus is a server state management library for React that provides full control over data, leading to a better user experience.โ
yadf
jRimbault
โYet Another Dupes Finderโ
awesome
Senzing
โCurated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.โ