Duplicate files can be removed using the rdfind command in Linux. To do so open a terminal window and first install rdfind as below:$ sudo apt-get install rdfind <enter>
Then, check for duplicate files on a medium:$ rdfind true . <enter>
. is the current directory where I ran rdfind
Make sure you have a data backup before deleting any files.
Lastly, after confirming that results.txt lists out what are duplicates and that you need to delete the duplicate files, enter the below command:$ rdfind -deleteduplicates true . <enter>
. is the current directory where I ran rdfind.
rdfind matches hashes to identify indentical files.