I know a lot of people are always concerned about google web crawlers etc....
Has the staff here ever looked into a robots.txt file for the top level directory?
http://www.robotstxt.org/
- GP
- 01-18-2010, 11:13 PM
- GneissGuy
- 01-19-2010, 05:06 PM
[ame="http://www.eccie.net/showthread.php?t=1119"]http://www.eccie.net/showthread.php?t=1119[/ame]
- GP
- 01-19-2010, 08:02 PM
that thread does not really answer the question?
- administrator
- 01-19-2010, 10:14 PM
yes, GP, we have.
- Omahan
- 01-20-2010, 08:54 AM
I found a robot and I'm keeping it. 
- GP
- 01-20-2010, 09:43 AM
Have you ever seen the video of that robot? Scary!!!