SunQuest
           ASP Programming
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsProgramming Languages - MoreASP Programming

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
Generate data entry and reporting .NET Web apps in minutes, straight from your database. Read our FREE whitepaper “Build Web 2.0 Applications Without Hand-Coding” Download now!
  #1  
Old April 7th, 2008, 12:33 PM
Destruantes Destruantes is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Nov 2005
Posts: 76 Destruantes User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 23 h 9 m 38 sec
Reputation Power: 3
Spiders bots and other crawling things

In my line of work I get access to alot of websites, mostly those of midsized and large corporations. Now...on a website I was on earlier today I saw something interesting, they had a content management system (cms) wich listed the amount of traffic from bots and when they last visited, ie you could see googlebots last visit etc, now...this kind of got me thinking 'cause it ain't often that I come across stuf that makes me go "how the fook did they do that?" but now..I must admit that very thought crossed my mind. So...my question is:

How can you keep track of bots that visit your site and is it possible o make dummy pages so to speak so that malbots and spambots stay the fook away? I know, I know I can add image checks or math questions or something like that to the login, but to spare the users of that, is there a way to check if the visitor is a human or not and then redirect it if it isn't?

I thought about checking the visitors web browser, but maybe the bots use those too? Any thoughts?

Reply With Quote
  #2  
Old April 7th, 2008, 06:09 PM
CodeHack CodeHack is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2008
Location: Lehigh Valley, PA
Posts: 18 CodeHack User rank is Corporal (100 - 500 Reputation Level)CodeHack User rank is Corporal (100 - 500 Reputation Level)CodeHack User rank is Corporal (100 - 500 Reputation Level)CodeHack User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 16 h 1 m 17 sec
Reputation Power: 0
The information needed to determine if a request is a bot or not is stored in the IIS Website logs. So doing a real time check like that seems unlikely. You would have to make a trip to the log and analyze the data to determine which page to serve up.

Reply With Quote
  #3  
Old April 7th, 2008, 07:49 PM
Doug G Doug G is offline
Grumpier Old Moderator
Dev Shed God 12th Plane (10500 - 10999 posts)
 
Join Date: Jun 2003
Posts: 10,717 Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level)Doug G User rank is Brigadier General (60000 - 70000 Reputation Level) 
Time spent in forums: 1 Month 40 m 34 sec
Reputation Power: 688
Is this question related to asp?
__________________
======
Doug G
======
"Hide, hide witch! The good folk come to burn thee. Their keen enjoyment hid behind their gothic mask of duty." -Mark Clifton

Reply With Quote
Reply

Viewing: Dev Shed ForumsProgramming Languages - MoreASP Programming > Spiders bots and other crawling things


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 2 hosted by Hostway