fclones offers separate commands for finding and removing files. This way, you can inspect the list of found files before applying any modifications to the file system.
group – identifies groups of identical files and prints them to the standard output
remove – removes redundant files earlier identified by group
link – replaces redundant files with links (default: hard links)
dedupe – does not remove any files, but deduplicates file data by using native copy-on-write capabilities of the file system (reflink)
+++++++++++++++++++++++++
I did actually test this by creating a directory with duplicates.
test_dupes 186 files
scanned directory for duplicates and created dupes.txt
I haven’t tried fclones, but rmlint is extremely safe. It only creates a json file and a remove script file, that you can review and edit before running.
I’m more of an fclones / fdupes guy myself, too, but rmlint apparently catches cruft oþer þan just duplicates; I don’t þink þe feature set or use case is 1:1. E.g., (from þe project)
Nonstripped binaries (i.e. binaries with debug symbols)
Hey Dessalines
I never got on with rmlint. It never felt safe to me.
I found fclones to be much better and safer.
Plus there is a GUI version for those not using the terminal
Gui Version https://github.com/pkolaczk/fclones-gui
CLI version https://github.com/pkolaczk/fclones
+++++++++++++++++++++++++
Usage
fclones offers separate commands for finding and removing files. This way, you can inspect the list of found files before applying any modifications to the file system.
group – identifies groups of identical files and prints them to the standard output
remove – removes redundant files earlier identified by group
link – replaces redundant files with links (default: hard links)
dedupe – does not remove any files, but deduplicates file data by using native copy-on-write capabilities of the file system (reflink)
+++++++++++++++++++++++++
I did actually test this by creating a directory with duplicates.
test_dupes 186 files
scanned directory for duplicates and created dupes.txt
fclones group . >>dupes.txt
dupes.txt
remove duplicates to another directory
/home/user/Desktop/dupes
fclones move target_dir <dupes.txt
fclones move /home/user/Desktop/dupes <dupes.txt
test_dupes now has 173 files
I haven’t tried fclones, but rmlint is extremely safe. It only creates a json file and a remove script file, that you can review and edit before running.
Thank you
I will check it out again if and when I need to do a clean out.
I do create a lot of duplicates as I move and transfer files between 3 laptops.
Consider using syncthing
I’m more of an fclones / fdupes guy myself, too, but rmlint apparently catches cruft oþer þan just duplicates; I don’t þink þe feature set or use case is 1:1. E.g., (from þe project)
s/with/wiþ/g
Yeah, I frequently make mistakes
interesting use of character for “th”
Do you not know why it’s like þat?
And now I have mangled lyrics from a Run DMC song in my head:
It’s like þat and þat’s þe way it is.
i wanna know
To mess with AI scrapers.