Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old May 2nd, 2006, 10:32 AM
VinylSurrender VinylSurrender is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2006
Posts: 61 VinylSurrender User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 10 m 5 sec
Reputation Power: 3
Send a message via MSN to VinylSurrender
Thumbs up Yahoo BOT name

Hi

Can someone tell me the name of the Yahoo Bot that comes to my site. I get hits from Yahoo searches (although not many) but I can't identify from my site stats which is their bot. It's obv which is the Google, Google Adsense, MSN etc...

Thanks.
Richard.

Reply With Quote
  #2  
Old May 2nd, 2006, 10:43 AM
Gnome101's Avatar
Gnome101 Gnome101 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Dec 2004
Posts: 316 Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 24 m 11 sec
Reputation Power: 5
it's Yahoo! Slurp


Reply With Quote
  #3  
Old May 2nd, 2006, 01:05 PM
VinylSurrender VinylSurrender is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2006
Posts: 61 VinylSurrender User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 10 m 5 sec
Reputation Power: 3
Send a message via MSN to VinylSurrender
Would that be 'Inktomi Slurp' then (my biggest hitter so far in the two days of May) because there isn't a Yahoo! Slurp in my list?

What's Inktomi ?

Reply With Quote
  #4  
Old May 2nd, 2006, 05:20 PM
Gnome101's Avatar
Gnome101 Gnome101 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Dec 2004
Posts: 316 Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 24 m 11 sec
Reputation Power: 5
At one point, I think that the INk bot was it's own little bot for Hot Bot search engine, but all the material I found links it to Yahoo!'s help pages.

I think it's safe it say that Yahoo! is 'slurping' your pages.

Reply With Quote
  #5  
Old May 2nd, 2006, 10:26 PM
VinylSurrender VinylSurrender is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2006
Posts: 61 VinylSurrender User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 10 m 5 sec
Reputation Power: 3
Send a message via MSN to VinylSurrender
Thanks!

The Yahoo slurper hits the robots.txt file every third visit, whereas the Google slurper hits the robots.txt file just now and then. What's going on?

I only get 5% of the hits from Yahoo searches as I get with Google - that's a massive difference. What can I do about this, any ideas?

Reply With Quote
  #6  
Old May 2nd, 2006, 11:40 PM
Gnome101's Avatar
Gnome101 Gnome101 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Dec 2004
Posts: 316 Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 24 m 11 sec
Reputation Power: 5
Well 90% of your search hits will come from google, just becasue of the fact that Google is that much more popular.

You really want to SEO for google. It's hard, but done right, you'll have targeted hits that will matter.

As for Slurp hitting your robots file, I am not sure. Google actually grabs mine once every couple of hours, and then moves on without going on further. The bots are odd in the their methods.

Reply With Quote
  #7  
Old May 3rd, 2006, 09:58 AM
VinylSurrender VinylSurrender is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2006
Posts: 61 VinylSurrender User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 10 m 5 sec
Reputation Power: 3
Send a message via MSN to VinylSurrender
What's going on then in terms of hits on my site is nothing strange then, thanks.

The only thing I do with robots.txt is: -

User-agent: *
Disallow: /Backup
Disallow: /Code tests

- basically saying, come on in, welcome, but please don't bother with the Backup or Code tests directories. Does that seem ok?

Reply With Quote
  #8  
Old May 3rd, 2006, 11:14 AM
Gnome101's Avatar
Gnome101 Gnome101 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Dec 2004
Posts: 316 Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 24 m 11 sec
Reputation Power: 5
That looks good to me.

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > Yahoo BOT name


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway
Stay green...Green IT