|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
Pages just wont spider...
Hi, this webpage i have had up for a while now keeps spidering on google but only the homepage. It simply wont spider the internal pages but i cant see any reason why not. I'm using the same methods i always use. Can anyone shed any light on this.
the address is http://www.war-medals.com/ Thanks ![]() |
|
#2
|
||||
|
||||
|
Try removing the preceeding slash from the hrefs (<a href="/services.htm") or use the absolute path.
__________________
ATB ![]() UK Political Debates online shopping Tec-books: Photoshop instruction manuals |
|
#3
|
|||
|
|||
|
According to me, use sitemap in your site. Sitemap is useful. It gives information about your site. Sitemap helps in improved spidering.
|
|
#4
|
|||
|
|||
|
Quote:
i will give this a whirl and report back |
|
#5
|
||||
|
||||
|
Using google sitemaps will also tell you which pages google is having problems with spidering (if any).
Also google is reporting back no inbound links to your site, this may have something to do with why you're not getting spidered http://www.google.com/search?hl=en&lr=&q=link%3Awww.war-medals.com&btnG=Search
__________________
Cooking Forums |
|
#6
|
|||
|
|||
|
I haven't seen any webmaster complaining about the Google sitemap, so nowadays it's really a must for websites.
|
|
#7
|
|||
|
|||
|
Quote:
I used absolute paths and they spidered. To be honest i thought google was more clever than that |
|
#8
|
||||
|
||||
|
Quote:
It is kinda strange. Some sites I monitor are crawled like crazy with relative URLs and others seem to require an absolute path. I have been wondering (in my case at least) if its anything to do with hosting several domains on the same hosting account server but I can't see why it should cause issues providing each domain points to it's own www (home) directory. |
|
#9
|
||||
|
||||
|
Very strange indeed. Surely relative links makes no difference. Its the volume of links that matters.
__________________
Interested in online gaming? Access full reviews of all UK Online casinos here.
Make Money from home |Roulette Strategy |William Hill | Viurgin | Jackpot joy | Spread Betting UK |
|
#10
|
||||
|
||||
|
Quote:
That's the rub - It 'should' make no difference, a link is a link and providing the target page exists there should be no difference whether it's referenced by absolute or relative paths. A crawler should come along, read the robots.txt file, obey the rules it finds ( ) and crawl the ahref's it finds.The quality and amount of external links is important but ineffective from an SEO point of view if they aren't being spidered. Last edited by Hombre : September 8th, 2006 at 08:36 AM. Reason: typo |
|
#11
|
|||
|
|||
|
Try add this into your website
<meta name="ROBOTS" content="INDEX, FOLLOW" /> hope this help loon http://www.webhostforasp.met It is better to be hated for who you are than to be loved for what you are not |
|
#12
|
|||
|
|||
|
I've set up a google sitemap and it's all looking fine in the webmaster tools.
darn googlebot still won't get past my homepage though! |
|
#13
|
||||
|
||||
|
Quote:
Yes I agree with you on this.Those whoa are complaining about Google sitemap simply do not know how to use it for getting maximum benefits.If you follow the guidelines set by Google properly and if your site is up to date then I don't think of any possible reason for not getting benefit from it.
__________________
VPS Hosting | Dedicated Server Hosting Email & MSN :: ryanw @ eUKhost.com || AIM :: RyanUKweb Complete Web Hosting Solutions at eUKhost.com |
|
#14
|
|||
|
|||
|
Quote:
Hi Andrew your website is fine and is indexing quite well so it's not a problem with your code at all, I own a new Zealand based search engine and I am just indexing it for you right now and it is indexing fine: So far we have found the following files that have been indexed: - -contact.htm -medals-1.htm -medals-2.htm -medals-3.htm -medals-4.htm -medals-5.htm -medals.htm -services.htm |
![]() |
| Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > Pages just wont spider... |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|