Ask HN: Identify duplicate files in my data hoard?
Backing up my documents and files to portable hard drives has been my strategy for decades now. I have so much data now, copied from one machine after another, from one drive to another that I have multiple copies of many files squirreled away in different locations on my backup drives (who knows how that happens — organization strategies changing over time?).
There has to be a tool (script?) that can scan a volume and using filenames, file sizes, come up with a list of possible duplicate files.
I don't think I would trust it to auto-cleanup (auto-delete duplicates) but at least with the duplicate paths laid out I could go through and begin the slow process of pruning until I have a final, canonical (and singular) backup of my files.
(Bonus if I can point it at the iCloud for the same purpose.)
There has to be a tool (script?) that can scan a volume and using filenames, file sizes, come up with a list of possible duplicate files.
I don't think I would trust it to auto-cleanup (auto-delete duplicates) but at least with the duplicate paths laid out I could go through and begin the slow process of pruning until I have a final, canonical (and singular) backup of my files.
(Bonus if I can point it at the iCloud for the same purpose.)