Jump to content

Whats a good duplicate file finder?


Recommended Posts

If you're using Windows, from command prompt use: dir /s

Link to comment
Share on other sites

  • 1 year later...

I need a program that will can a folder/HD and locate all duplicate copies of a file. any ideas of a good free one??

i frequent an image board and use flashgot to download massive amounts of pics at a time and end up with a lot of duplicates with different filenames.

best tool ive found is clone remover


the free version has a delay before each use (last time i had to wait 90 seconds to use the program) and only allows you to remove 20 files at a time. the program basically scans w/e folders you tell it to for files with the same contents. it will then list those files and you can check off the ones you want to remove and it gives you the option to send them to the recycle bin or remove them completely.

i use it under the free version. basically it gives me my list. i check off 20 items. remove them. rescan the files. and repeat until i have no more duplicates.


oh good lord i just noticed how old the OP is >.> topic necromancy ftl

Edited by RogueHart
Link to comment
Share on other sites

  • 1 year later...
  • 5 months later...

Ever think of using vbox with a distro like Knoppix which is loaded with GNU apps to find dup. files. Seems like your looking around for a utility that can perform binary comparisons. It exists in Linux and its free. You can figure it out...rather than pick your nose with the shareware.

Link to comment
Share on other sites

  • 3 weeks later...

Here's a simple one:

echo "#! /bin/sh" > $OUTF;
find "$@" -type f -print0 |
xargs -0 -n1 md5sum |
sort --key=1,32 | uniq -w 32 -d --all-repeated=separate |
sed -r 's/^[0-9a-f]*( )*//;s/([^a-zA-Z0-9./_-])/\\\1/g;s/(.+)/#rm \1/' >> $OUTF;
chmod a+x $OUTF; ls -l $OUTF


sed -r 's/^[0-9a-f]*( )*//;s/([^a-zA-Z0-9./_-])/\\\1/g;s/(.+)/#rm \1/' >> $OUTF;


sed -r 's/^[0-9a-f]*( )*//;s/([^a-zA-Z0-9./_-])/\\\1/g;s/(.+)/rm \1/' >> $OUTF;

if you wish to delete it when running the shell-script it creates (duplicates.sh).

On windows? Well, mount your win-drive over smb and run it from a *nix system or cygwin it from within windows.

Link to comment
Share on other sites

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...