
June 5th, 2009, 09:37 PM
|
 |
Green Eggs And Ham
|
|
|
|
|
Htaccess and bot killing
Here is a fascinating page on blocking bots with htaccess that ignore robots.txt. It is, however, several years old.
http://diveintomark.org/archives/20...s_to_go_to_hell
Are there any similar resources that are "fresher" in terms of bot names and IP addresses? I imagine that well known bots change IPs now and then to avoid this type of countermeasure.
THANKS!
__________________
Welfare is OK with the Neo-Cons as long as it's corporate welfare.
|