Jump to content

Recommended Posts

Posted

mmmm... ye, the forums have also been slow recently, it seemed to start when the IRC debate started, so I'm guessing (assuming nothing malicious happened) that peopel moved from IRC to the forums to find out wtf was going on.

Posted

Something is wrong, however I am at the office right now and I'm having to argue with a sys-admin in pigeon German about exactly how you need to configure vzzp nameservers on the fracking node.

I think its either google bot, our friends at level 3 again or the database needs another kick...

Posted

everything seems to be running smoothly. I haven't encountered any error as of yet. Seems like someone fixed the issue or it just fixed itself.

Posted

We get a lot of google bot traffic and it seems to swamp the forums while its doing its stuff. Does anyone know of a way of creating a robots.txt that will tell the spiders to take it easy?

Posted

I'd be really surprised if it due to a bot... more than likely a problem with your host. php sends a write db request... odbc b0rks for some reason... php tries to request data that does not exist, therefore generates a page that does not exist... 404.....

Posted

I doubt that, mainly due to the amount of Google or Level 3 IP's being tracked by phpbb during the timeout sessions. I should probally have a look at the apache logs tonight.

Posted
put the following 2 lines in a file at http://hak5.org/robots.txt

User-agent: *

Disallow: /forums/

that should fix any problems with googlebot or any other bots messing with the forums

have you ever tried that with Slurp (yahoo). Slurp never follows the rules...bad yahoo...bad...

It can be done using the .htaccess file for bots that don't follow the robots rule. Example:

SetEnvIfNoCase user-agent  "Zibber" bad_bot=1

<FilesMatch "(.*)">

Order Allow,Deny

Allow from all

Deny from env=bad_bot

</FilesMatch>

I use this for about, oh, 30-40 bots that I block. A lot of bots don't follow the robots.txt rules and are only interested in harvesting emails and php pages that use things to post messages, like Guest Books and BB's.

Posted

Could yahoo possibly do anything else to be more annoying. Between buying companies and f'n them up all the way down to things like this. It's no wonder google kicks there butt all the time.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...