Timmo Posted November 20, 2008 Share Posted November 20, 2008 hi all, i was just wondering if there was any programs out there that could add all my word lists into 1 big file. i have been collecting for a while now (have collected about 170 wordlists) but its a bit of an inconvenience to have to make a script with 170+ lines in it so i can walk away to compute all words. is there such a program? for linux? i could always use autoit on my windows box (write a script to do it) and build them that way but if there is already a program that has been made it would be great cheers Quote Link to comment Share on other sites More sharing options...
stingwray Posted November 20, 2008 Share Posted November 20, 2008 The linux command line has all the tools to do it for you. Joining the files up, making sure all the words are unique and then sorting them. Have a look around. Quote Link to comment Share on other sites More sharing options...
Jayze Posted November 20, 2008 Share Posted November 20, 2008 cat file2 >> file1 (joining them) cat file1 | sort -n | uniq | sort > newfile that should do the trick on the commandline Quote Link to comment Share on other sites More sharing options...
Timmo Posted November 20, 2008 Author Share Posted November 20, 2008 Thanks heeps guys. I didn't know about being able to use the cat command to remove duplicates Thanks again Quote Link to comment Share on other sites More sharing options...
stingwray Posted November 20, 2008 Share Posted November 20, 2008 'cat' doesn't, 'uniq' does. The name gives it away. Quote Link to comment Share on other sites More sharing options...
PLuNK Posted November 20, 2008 Share Posted November 20, 2008 Well hopefully you know what a system pipe is.. If you don't, Might want to pick up a BASH guide. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.