Current time: 03-20-2010, 09:28 AM Hello There, Guest! (LoginRegister)


Post Reply 
Most effective way to block google from indexing certain forums.
01-08-2009, 11:30 PM (This post was last modified: 01-08-2009 11:31 PM by Netbuddy.)
Post: #1
Most effective way to block google from indexing certain forums.
Just wondering if this is achievable at all. I have a friend that runs a VB board, several years after it launched, he still finds it difficult to block google from indexing certain forums on his site.

Im not looking for a fullproof method. I dont think thats possible, but simply the most effective methods people have come up with so far.

Any help is really appreciated. If I can say I've made every effort to make a forum private, and it gets indexed anyway, at least ive covered my own backside. Big Grin

I only want some forums private, on a selective basis, not the entire site.

Any help is really appreciated.
Find all posts by this user
Quote this message in a reply
01-09-2009, 04:34 AM
Post: #2
RE: Most effective way to block google from indexing certain forums.
Admin_CP_Config_Spiders
Find all posts by this user
Quote this message in a reply
01-09-2009, 09:04 AM
Post: #3
RE: Most effective way to block google from indexing certain forums.
The best probable way is to use a robots.txt to disallow access.

http://www.robotstxt.org/faq/prevent.html

Like it says, this will only block the well-behaved spiders that check the robots.txt file. I guess you can hard code it so that access is denied for specific spider user agents.

Tomm M
MyBB Developer ยป Marketing Designer & Systems Developer
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump: