SunQuest
           Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old August 23rd, 2005, 12:57 PM
Yahn Yahn is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2005
Posts: 162 Yahn User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 19 h 4 m 35 sec
Reputation Power: 3
spiders

Google visits my web site sometimes up to twice a day but they havn't deep crawled it yet, why is that? Yesterday I was working on a php page and it was up for maybe 2 minutes and google spidered it, yet they won't spider any of my important pages, why is that? The php page was not linked to any other pages on the site and the important pages are linked to the default page which google visits daily. My website is www.yahn.org if anyone wanted to see what the problem could be. Thank you very much.

Reply With Quote
  #2  
Old August 26th, 2005, 10:45 AM
thedagda thedagda is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jan 2005
Posts: 30 thedagda User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 6 h 52 m 24 sec
Reputation Power: 4
My suggestions would be:

- add more keyword heavy content - especially on the home page.
- add navigation to each of the content pages. the spider goes there and runs into a dead end.
- on the home page, add more descriptive link anchor text.
- Create a sitemap for site and make sure it is linked from the home page - with good anchor text.

These things should help.

conor
Comments on this post
Yahn agrees!

Reply With Quote
  #3  
Old August 26th, 2005, 05:37 PM
Yahn Yahn is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2005
Posts: 162 Yahn User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 19 h 4 m 35 sec
Reputation Power: 3
I'm working on the site map right now, I have everything I need I just need to put it together with php, and figure out how I want to do it. What do you mean by more descriptive link anchor text? Do you mean like add a title attribute or something else?

Anyways the spider isn't running into dead ends, in my latest visitor stats it shows that google visited the home page, g.php, favicon.ico, and robots.txt. It doesn't show that it ever went through the rest of the site to even run into a dead end.

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > spiders


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 2 hosted by Hostway