greendixy Posted July 25, 2010 Share Posted July 25, 2010 someware on the forum i have seen a way to grep a crapload of wordlist and sort it to a single file was wondering if someone had the command on hand thank you Quote Link to comment Share on other sites More sharing options...
Infiltrator Posted July 25, 2010 Share Posted July 25, 2010 http://www.cyberciti.biz/faq/howto-use-gre...-in-linux-unix/ http://lowfatlinux.com/linux-grep.html Quote Link to comment Share on other sites More sharing options...
greendixy Posted July 25, 2010 Author Share Posted July 25, 2010 thanks for trying m8 but thoes dont even come close to giving me info for what i need Quote Link to comment Share on other sites More sharing options...
Mr-Protocol Posted July 25, 2010 Share Posted July 25, 2010 I dont understand what you want to do. Take multiple lists into one sorted? Or make a huge brute force pass list? Quote Link to comment Share on other sites More sharing options...
greendixy Posted July 25, 2010 Author Share Posted July 25, 2010 i got like 20+ list i know there is some same passwords in each one i want to transfer all passwords to one file taking out the same passwords if possible soo lets say List a.txt b.txt c.txt to some file.lst so it would grep *.txt to *.lst taking out the same passwords if possible Quote Link to comment Share on other sites More sharing options...
Mr-Protocol Posted July 25, 2010 Share Posted July 25, 2010 Combine the lists using whatever means you want. then instead of grep use 'uniq' and 'sort' sort biglist.txt | uniq -u > /root/cleanbiglist.txt Quote Link to comment Share on other sites More sharing options...
greendixy Posted July 25, 2010 Author Share Posted July 25, 2010 thank you that should work Quote Link to comment Share on other sites More sharing options...
greendixy Posted July 26, 2010 Author Share Posted July 26, 2010 (edited) So here is my rundown Decided to do "cat" to group all my files greendixy@bt:~$ cat *.txt > cleanlist.lst <-- worked great Then i just used your command and it cleaned it up fairly well greendixy@bt:~$ sort cleanlist.lst | uniq -u > cleanlist.txt And here is the list it's not as big like the 2+ gig ones lol cleanlist.txt Name : cleanlist.txt Size : 33 MB Edited July 26, 2010 by greendixy Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.