05-19-2006, 12:35 AM
Code:
User-Agent: Googlebot
Disallow: /
User-Agent: Googlebot-Image
Disallow: /Means that Googlebot, and Googlebot-Image ignores all directores, with subdirectories too.
And I just created the file after we had the huge bandwidth-eating, before there wasnt any at all. I'm only disallowing Google because it consumed a huuuuge amount of bandwidth in the days up until we ran dry of it.
url=http://www.copy-pasta.com]CopyPasta[/url] - FilePasta