How to stop GoogleBot?


#1

Hi,

I currently have MyBB installed on my site and seems that GoogleBot is the one who is always online and crawl the site. How do I stop it to crawl to all thread ?

Dino
Get YOUR $97 off on yearly plan with [color=#CC0000]YOUGET97 [/color] promo code. Sign Up NOW


#2

It’s in their FAQ:
http://www.google.com/support/webmasters/bin/topic.py?topic=8843

-Scott


#3

Put this in your robots.txt file:

User-agent: Googlebot Disallow: /si-blog
Max discount on any plan with promocode SCJESSEYTOTAL


#4

Thanks Scott, this is what I need !

Dino
Get YOUR $97 off on yearly plan with [color=#CC0000]YOUGET97 [/color] promo code. Sign Up NOW


#5

[quote]User-agent: Googlebot
Disallow: /[/quote]
Thanks SCJessey !

Dino
Get YOUR $97 off on yearly plan with [color=#CC0000]YOUGET97 [/color] promo code. Sign Up NOW


#6

Call on “Voltron”?

Wholly - Use promo code WhollyMindless for full 97$ credit. Let me know if you want something else!