|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
Hi
Can someone tell me the name of the Yahoo Bot that comes to my site. I get hits from Yahoo searches (although not many) but I can't identify from my site stats which is their bot. It's obv which is the Google, Google Adsense, MSN etc... Thanks. Richard. |
|
#2
|
||||
|
||||
|
it's Yahoo! Slurp
![]() |
|
#3
|
|||
|
|||
|
Would that be 'Inktomi Slurp' then (my biggest hitter so far in the two days of May) because there isn't a Yahoo! Slurp in my list?
What's Inktomi ? |
|
#4
|
||||
|
||||
|
At one point, I think that the INk bot was it's own little bot for Hot Bot search engine, but all the material I found links it to Yahoo!'s help pages.
I think it's safe it say that Yahoo! is 'slurping' your pages. |
|
#5
|
|||
|
|||
|
Thanks!
The Yahoo slurper hits the robots.txt file every third visit, whereas the Google slurper hits the robots.txt file just now and then. What's going on? I only get 5% of the hits from Yahoo searches as I get with Google - that's a massive difference. What can I do about this, any ideas? |
|
#6
|
||||
|
||||
|
Well 90% of your search hits will come from google, just becasue of the fact that Google is that much more popular.
You really want to SEO for google. It's hard, but done right, you'll have targeted hits that will matter. As for Slurp hitting your robots file, I am not sure. Google actually grabs mine once every couple of hours, and then moves on without going on further. The bots are odd in the their methods. |
|
#7
|
|||
|
|||
|
What's going on then in terms of hits on my site is nothing strange then, thanks.
The only thing I do with robots.txt is: - User-agent: * Disallow: /Backup Disallow: /Code tests - basically saying, come on in, welcome, but please don't bother with the Backup or Code tests directories. Does that seem ok? |
|
#8
|
||||
|
||||
|
That looks good to me.
|
![]() |
| Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > Yahoo BOT name |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|