|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
|
|
Be the architects of evolution and help create the mobile internet future. It’s your move---enter to win here! |
|
#1
|
|||
|
|||
|
can u show me how to stop him in "iptables" ??????????
4-0 5254 0/91/91 _ 0.06 11036 0 0.0 0.48 0.48 66.28.98.5 www.myserver.com GET /robots.txt HTTP/1.0
5-0 5255 0/105/105 _ 0.06 9369 0 0.0 0.28 0.28 66.28.98.4 www.myserver.com GET /robots.txt HTTP/1.0 this is taken from the same status report. can u show me how to stop him in "iptables" ??????????
__________________
regards, wish to use AT 89c51 single chip computer to do remote sensing and send the data back from woods to office via nokie 3330 and internet. HOW? first I must revise C program thro' example, what's next? Last edited by pentium5 : March 12th, 2002 at 07:04 AM. |
|
#2
|
|||
|
|||
|
why do you want to stop him? seems like a crawler from a search engine and if it only requests robots.txt, this is fine, it complies to the standards.
give it a "robots.txt" with: User-agent: * Disallow: / and it won´t bother you... there is 10000s like this on the web, so you need to block quite many IPs. (i know of altavista having at least 100 different ones that showed up in my server logs already)
__________________
-- Manuel Hirsch - Linux, FreeBSD, programming, administration articles, tutorials and more. |
|
#3
|
|||
|
|||
|
>> why do you want to stop him?
Good question. Same question that we have asked pentium5 dozen (100+) times without a valid reason in doing so. Maybe he should setup some kind of access restriction in his docroot and have a default-to-deny policy. |
![]() |
| Viewing: Dev Shed Forums > Operating Systems > Linux Help > can u show me how to stop him in "iptables" ?????????? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|