therealgreg

Umm... you might want to check your facts before blindly posting false claims - you're not doing your street cred any favors, bro. Long story short... more than half the words are duplicates. Long story long... 1) This mega list "...982,963,904 words exactly no dupes..." contains only half over what you claim. After sorting and using 'uniq' command to output unique words to another file, we end up with just 493,220,993 words. For those keeping count, that's about half. 2) Then as a "bonus", he includes his personal list of 1.9GB, which equates to around 180 million words (checked using command "wc -l Custom-WPA" . Well... hate to burst another bubble, but after sorting and removing all dups, we end up with an adjusted bonus of 769MB, or 71 million words. This time we're left with way less than half. While I appreciate the millions of words, I really have a problem with the grand, false claims, which also makes me wonder how "decent" these lists really are. Also, it seems a waste to be torrenting around all that extra fat, if you know what I mean. So... all that to say... I have combined both lists, sorted and stripped out all duplicates, and am left with a 6.1GB file containing 494,564,103 words. I'm going to call this list "ForRealz-Super-WPA", and put it in my toolbox :)