TheFiresInTheSky
Jul 17 2006, 04:53 AM
why are these ppl logged in but you cant click on them or anything.
who are they?
rridgely
Jul 17 2006, 05:10 AM
Are you sure it was google.org and not .com?
Anway the search engines come to the site and cache all the keywords/topics/ect.
Its why when you do searches for things like a hijack this line or a topic about computers ccleaner forum will show up.
TheFiresInTheSky
Jul 17 2006, 05:17 AM
it was probably .com.
thats cool how they can do that.
why cant you click to view their profile?
did you pass them off as search engines or something?
JohnDemolition
Jul 17 2006, 05:33 AM
those things are just bots that go through each website so that they can cache the stuff on it. MrG can block those people with some kind of file which i forgot the name of, but there would be no point.
Eldmannen
Jul 17 2006, 03:24 PM
Web crawlers / spiders.
Can be blocked via the Robot Exclusion Standard using a robots.txt.
http://en.wikipedia.org/wiki/Robots_Exclusion_Standard
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please
click here.