Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed Forums > Web Design > Search Engine Optimization
Reload this Page

Why wont google crawl? - Advice Needed

Discuss Why wont google crawl? - Advice Needed in the Search Engine Optimization forum on Dev Shed.
Why wont google crawl? - Advice Needed Search Engine Optimization forum discussing related topics such as Google, PageRank, Link Exchange, and Link Popularity. Improve your ranking in the Search Engines by employing good optimization techniques.

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old December 21st, 2006, 05:09 PM
adammc's Avatar
adammc adammc is offline
Contributing User
Dev Shed Novice (500 - 999 posts)
  
Join Date: Sep 2004
Location: Cairns, Australia
Posts: 621 adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 45 m 37 sec
Reputation Power: 7
Question Why wont google crawl? - Advice Needed
Hi folks,

Can anyone explain why urls like the one below arent being indexed by Google:
http://www.webmastersite.com.au/web...ame-dot-com.php
http://www.webmastersite.com.au/web...sis-website.php

They are linked to from an article list page which is linked to from my main page.

They have been up for many months, my front page is a PR5, the article list page is a PR4.

And ideas?
__________________
Free Website Traffic | | Webmaster Tools
Reply With Quote
  #2  
Old December 21st, 2006, 07:02 PM
adammc's Avatar
adammc adammc is offline
Contributing User
Dev Shed Novice (500 - 999 posts)
  
Join Date: Sep 2004
Location: Cairns, Australia
Posts: 621 adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level)adammc User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 12 h 45 m 37 sec
Reputation Power: 7
OK, I am baffled now!

I found most of the articles were in fact indexed by google by searching for the article title in quoatation marks.

But when I type in the article urls into the searchbox, its telling me its not indexed?
Reply With Quote
  #3  
Old December 25th, 2006, 06:47 AM
etechsupport's Avatar
etechsupport etechsupport is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Apr 2005
Posts: 160 etechsupport User rank is Corporal (100 - 500 Reputation Level)etechsupport User rank is Corporal (100 - 500 Reputation Level)etechsupport User rank is Corporal (100 - 500 Reputation Level)etechsupport User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 4 Days 13 h 59 m 49 sec
Reputation Power: 8
Send a message via AIM to etechsupport Send a message via MSN to etechsupport
Do you have checked using this tool? https://www.google.com/webmasters/tools/sitestatus
I would suggest you to use google sitemap, I hope that link will lead you to their sitemap page.
__________________
Outsourced Technical Support || Server Management || Web Development
Phone : 408-512-1759 || AIM : support24by7 || MSN : sales@eTechSupport.net
24x7 Dedicated Web Hosting Support
Reply With Quote
  #4  
Old December 26th, 2006, 06:03 AM
jbjacob's Avatar
jbjacob jbjacob is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Oct 2006
Location: United Kingdom
Posts: 169 jbjacob User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 Days 15 h 12 m 31 sec
Reputation Power: 2
Send a message via ICQ to jbjacob Send a message via MSN to jbjacob
Yes I second etechsupport regarding the use of sitemap.
In order to get appropriate solution for your issue I suggests to provide some more details regarding what steps you have done in order to get your site crawled? Is your site new or you want to re index it.
This information will be helpful to guide you better.
Reply With Quote
  #5  
Old January 6th, 2007, 07:56 PM
Dave A Dave A is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Jan 2007
Posts: 5 Dave A User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 59 sec
Reputation Power: 0
Quote:
Originally Posted by adammc
Hi folks,

Can anyone explain why urls like the one below arent being indexed by Google:
(URL address blocked: See forum rules)
(URL address blocked: See forum rules)

They are linked to from an article list page which is linked to from my main page.

They have been up for many months, my front page is a PR5, the article list page is a PR4.

And ideas?


Hi well those pages are being indexed by my webspider with no problems at all, I just dropped my Kiwi search engines web spider into your website and it is indexing those files with no worries.
So far we have found the following directory structure and files:
(URL address blocked: See forum rules) (8 pages)
Root files
/affiliate-programs files
/forum files
/webmaster-tutorials files
It has only been in your host for a few minutes and it shows no problems at all.
Reply With Quote
  #6  
Old January 10th, 2007, 06:50 AM
ddwebguru ddwebguru is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Dec 2006
Posts: 6 ddwebguru User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 38 m 32 sec
Reputation Power: 0
but i checked two pages indexed in google.

type in google > site:www.webmastersite.com.au/webmaster-tutorials/article_buying-a-domain-name-dot-com.php


Seo Services
Reply With Quote
  #7  
Old January 25th, 2007, 04:35 AM
bryan_m's Avatar
bryan_m bryan_m is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Jan 2007
Posts: 98 bryan_m User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 17 h 35 m 51 sec
Reputation Power: 2
One more chances that your site may have been facing down time when google bot tried to crawled it. Just guessing.
Reply With Quote
Reply

Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > Why wont google crawl? - Advice Needed

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway. 
Stay green...Green IT