Qbasicnews.com
Index hidden if you're not looged in? Why? - Printable Version

+- Qbasicnews.com (http://qbasicnews.com/newforum)
+-- Forum: QbasicNews.Com (http://qbasicnews.com/newforum/forum-3.html)
+--- Forum: Site/Forum Issues (http://qbasicnews.com/newforum/forum-9.html)
+--- Thread: Index hidden if you're not looged in? Why? (/thread-9289.html)

Pages: 1 2

Index hidden if you're not looged in? Why? - relsoft - 05-16-2006

That's a recipe for disaster. :*(

Index hidden if you're not looged in? Why? - VonGodric - 05-16-2006

I agree with Rel

Index hidden if you're not looged in? Why? - xteraco - 05-16-2006

hmm, i agree to

Index hidden if you're not looged in? Why? - Rattrapmax6 - 05-16-2006

Yeah, that's creepy....

Who hit "Hide forum from guests" ? Cause new comers are going to think it's gone, or non-exsisting.... Losing new members..... etc.....

. . . .

Index hidden if you're not looged in? Why? - Sumo Jo - 05-16-2006

It's a temporary thing while we figure out why these bots are draining so much bandwidth from the site. The site used 18 gigs of bandwidth in a day the other day and I'm trying to save it so that it doesn't go down again until we make sure they all get blocked.

Index hidden if you're not looged in? Why? - RADIUM-V Interactive - 05-16-2006

Ya know, you can set it to automatically log in when you go here. Then you never have to know - unless you use a different computer.

Index hidden if you're not looged in? Why? - relsoft - 05-17-2006

Quote:Ya know, you can set it to automatically log in when you go here. Then you never have to know - unless you use a different computer.

err.... I'm not the only one who uses this computer.

Index hidden if you're not looged in? Why? - Agamemnus - 05-17-2006

Yeah that's creepy.

Maybe it's some sort of search engine. (maybe even google)

Confusedhifty:

Index hidden if you're not looged in? Why? - Sumo Jo - 05-17-2006

Quote:Yeah that's creepy.

Maybe it's some sort of search engine. (maybe even google)

Confusedhifty:

It is. At least one of the bots that's using it the most is google.

Index hidden if you're not looged in? Why? - yetifoot - 05-18-2006

I'm sure you have, but just in case you could check the robots.txt is correct?

Code:
User-Agent: Googlebot-Image
Disallow: /

Its been a long time since i wrote a robots.txt but should it be -


Code:
User-Agent: *
         Disallow: /index.php
         Disallow: /forum/
         Disallow: forum/
         etc...

Multiple forms of disallow (forum/, /forum/, /forum, forum ) to make sure robots really ignore it.