deduplicate file

最後更新: 2024-08-02

目錄


czkawka

 

https://github.com/qarmin/czkawka

Notes

 * czkawka 比 dupeGuru

 

Features

 * Written in memory-safe Rust
 * Amazingly fast - due to using more or less advanced algorithms and multithreading
 * Cache support - second and further scans should be much faster than the first one
 * CLI & GUI frontend
 * Multiplatform

功能

Duplicates - Finds duplicates based on file name, size or hash(支援 xxh3)

 


dupeGuru

 

https://github.com/arsenetar/dupeguru/

dupeGuru is a cross-platform (Linux, OS X, Windows) GUI tool to find duplicate files in a system.
It is written mostly in Python 3 and uses qt for the UI.

It has three modes, Standard, Music and Picture

dupeGuru has 3 basic ways of scanning: Worded scans and Contents scans and picture blocks.
The first two types are for the Standard and Music modes, the last is for the Picture mode.

Contents scans

start by looking at file sizes.
After having grouped our files by size, we discard every file that is alone in its group.
Then, we proceed to read the contents of our remaining files.

MD5 hashes are used to compute compare contents.

 


Fclones

 

One of the fastest tools to find duplicates; it is written also in Rust

https://github.com/pkolaczk/fclones

Creative Commons license icon Creative Commons license icon