Htaccess and bot killing

Dev Shed Forums Sponsor:

June 5th, 2009, 09:37 PM

Arty Ziff

Green Eggs And Ham

Join Date: Apr 2005

Posts: 4,780

Time spent in forums: 3 Months 2 Weeks 13 h 48 m 54 sec
Reputation Power: 3075

Htaccess and bot killing

Here is a fascinating page on blocking bots with htaccess that ignore robots.txt. It is, however, several years old.

http://diveintomark.org/archives/20...s_to_go_to_hell

Are there any similar resources that are "fresher" in terms of bot names and IP addresses? I imagine that well known bots change IPs now and then to avoid this type of countermeasure.

THANKS!

__________________
Welfare is OK with the Neo-Cons as long as it's corporate welfare.

Viewing: Dev Shed Forums > System Administration > Apache Development > Htaccess and bot killing

« Previous Thread | Next Thread »

Thread Tools	Search this Thread
Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts vB code is On Smilies are On [IMG] code is On HTML code is Off

View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox

Forum Jump

Free IT White Papers!

How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

More Free IT White Papers!