|
|||||||||
|
|||||||||
| |||||||||
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
Dev Shed Forums Sponsor:
|
|
|
|
#1
January 25th, 2002, 06:52 PM
|
|||
|
|||
|
how can I know what robot.txt is doing??
how can I know what robot.txt is doing??
is there a way to know what they are doing and can I programming a robot to fight back!?   
__________________
regards, wish to use AT 89c51 single chip computer to do remote sensing and send the data back from woods to office via nokie 3330 and internet. HOW? first I must revise C program thro' example, what's next?
|
|
#2
January 26th, 2002, 01:38 AM
|
|||
|
|||
|
Check your access_log. Keep in mind, it should be named robots.txt.
>> can I programming a robot to fight back!? What? A good robot obeys robot rule. Likewise, a bad robot doesn't care. So why need a fight back? Why are you asking all these again and again? If you are that worry, why don't you just block all UserAgents unless otherwise specified explicitly?
|
|
| Viewing: Dev Shed Forums > System Administration > Apache Development > how can I know what robot.txt is doing?? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
 |
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
