Jump to content

we need to implement this on the forums ASAP :O

DLSS

By DLSS
in Everything Else

 Share

Recommended Posts

DLSS Newbie

DLSS

Posted
Posted

check it out, we allready have spamfilters, but heres the stupid filter :p

it automatically filters out stupid posts on the forum (including L33TsP34k , ROFLMAO , etc)

check it out :p -> http://stupidfilter.org/

the about page :

The concept behind the StupidFilter Project originated during a conversation between Gabriel Ortiz and Paul Starr. StupidFilter was conceived out of necessity. Too long have we suffered in silence under the tyranny of idiocy. In the beginning, the internet was a place where one could communicate intelligently with similarly erudite people. Then, Eternal September hit and we were lost in the noise. The advent of user-driven web content has compounded the matter yet further, straining our tolerance to the breaking point.

It's time to fight back.

The solution we're creating is simple: an open-source filter software that can detect rampant stupidity in written English. This will be accomplished with weighted Bayesian or similar analysis and some rules-based processing, similar to spam detection engines. The primary challenge inherent in our task is that stupidity is not a binary distinction, but rather a matter of degree. To this end, we're collecting a ranked corpus of stupid text, gleaned from user comments on public websites and ranked on a five-point scale.

Eventually, once the research is completed, we plan to release core engine source code for incorporation into content management systems, blogs, wikis and the like. Additionally, we plan to develop a fully implemented Firefox plugin and a Wordpress plugin.

the faq :

Is this a joke?

    No, this is not a joke.

How are you going to manage to recognize stupidity programmatically?

    Pretty much the same way you can programmatically recognize spam, we'll look for things that characterize stupidity and assign particular tokens different weights based on how often they occur in hand-picked examples of idiotic comments. For more information, see Naive Bayes Classifiers and CRM114.

When do you expect to have usable code?

    We expect to start releasing alpha source code around the middle of March, 2008.

Isn't filtering stupidity elitist?

    Yes. Yes, it is. That's sort of the whole point.

Do you really expect to be able to detect and filter anything that's conceivably stupid?

    No, of course not. You'd need real AI for that, and beyond a certain point it's simply subjective; after all, a sufficiently advanced AI would probably filter out the whole of human discourse, which isn't the idea.

So what do you plan to filter?

    The idea is that the most egregiously stupid comments will also be the easiest to detect while remaining ignorant of context; comments with too much or too little capitalization, too many text-message abbreviations, excessive use of "LOL," exclamation points, and so on.

How do you rate stupidity?

    Since we're trying to build a detailed database that serves as a very verbose example of What Not To Do, we look for comments whose prose style we can point to and say, "I don't even have to understand the content of this comment to know that it's stupid," -- based on the gross prose style alone, its stupidity is self-evident. It is then useful as an example for our parser to integrate into its database of stupidity.

I looked at some of the results from the Random Stupidity page, and they don't seem that stupid to me; what gives?

    Keep in mind we grade stupidity on a scale of 1 to 5. Someone might get a 1 or 2 for a comment that used no punctuation, whereas a comment consisting of nothing but text message abbreviations with a dash of LOLLLLL thrown in for good measure would probably rate a solid 4 or 5. There is a certain amount of subjectivity, and our software is aware of that; scoring will be normalized to eliminate excessively generous or harsh estimations of stupidity.

What about ironic uses of "stupid" diction?

    The StupidFilter is blind to irony. Our intent is that one or two instances of "lol" or "ur dum" in several paragraphs of otherwise-cogent text won't result in a false positive. However, we consider the StupidFilter's irony-ignorance to be a feature, insofar as even if an allegedly smart person makes a short, stupid comment, their smartness doesn't make the comment any less stupid. If your mom had designed the StupidFilter, she might say "If you can't say anything smart, don't say anything at all."

Won't people just try to defeat the filter, the way spammers try to get around spam filtering?

    We certainly hope they will -- that implies they're no longer generating text statistically likely to be stupid. It's true that an obvious attack on the StupidFilter would be to salt a short, stupid comment with a long excerpt copy-pasted from, say, Project Gutenberg, but we think it's reasonable to count on the laziness of the stupidest commenters not to do this.

Aren't you just trying to eliminate comments and discourse that you consider to be stupid?

    As much as that might be nice, no. The StupidFilter does not understand, in a meaningful sense, the text that it parses, and our graders select comments that are formally stupid -- that is, their diction, not their content, marks them as stupid. It is not our intent to eliminate debate or disagreement, but rather to programmatically enforce a certain quality of expression. Put another way: The StupidFilter will cheerfully approve an eloquent, properly-capitalized defense of mandatory, state-subsidized rocket-launcher ownership for all schoolchildren.

Isn't that a very prescriptivist position to take?

    Yes, and we are equally aware that this will make us few friends in linguistics circles. But effective textual communication requires at least some formal rigor, and we feel such rigor is worth encouraging and, at times, enforcing.

Link to comment
Share on other sites
Razor512 Newbie

Razor512

Posted
Posted

i can count to 10 with out making a mistake

awww it didn't block the message :)

there many real life needs a stupid filter

(that would stop stupid problems like traffic jams which has been proven can be caused by 1 person causing the shock wave effect)

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
 Share
Go to topic listing

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...