Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old June 14th, 2005, 06:20 PM
3-rx 3-rx is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Posts: 12 3-rx User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 53 m 24 sec
Reputation Power: 0
why Gbot visit my site, but don't index

Hello

my site was dropped from Google SERPS 2.5-3 months ago (imho, when Bourbon update starts)

1-st month
1. mywebsite disappear from google (searching www.domain.com),
2. but are listed 15-20k results [site:domain.com] from my site (most of them with title and description, but with "supplemental result" mark)
========
2-nd month

1. 10-11k results, but most of them without title and description, and without supplemental result mark.

2. searching www.domain.com got =>2-3 years old homepage (like this: domain.com/blabla/) without title and description
========
3-rd month (may15-june15)

1. 500-600 results (+-20 every day) (50% without title and description)

for example i check my homepages in this results, it was visited at 13june, but in cache is result from 30 may !

2. domain.com (without www, without title and description)


=================

now pls check stats of my awstat

January (when everything is ok)
Googlebot 30752+168 1.93 GB

April (my site was dropped)
[btw before this i add ~near 20mb content]
Googlebot 5440+65 380.26 MB

May
Googlebot 8709+47 648.51 MB

June (for 15 days)
Googlebot 11145+31 351.84 MB

as u see from this last stats, gbot start to crawling (visiting) my pages, but u can see, that he don't index (cache it).

btw, i update site every day , and 10-13 days ago i change site structure and desing. so even old files must be changed.

what do u think?> what's the reason?
why google don't want to index or cache my pages?
or if he don't want to cache it, why he visit so much (btw all time gbot visit my site server load increased up to 80-90).

so i don't undestand strategy of google

thx

Reply With Quote
  #2  
Old June 23rd, 2005, 11:13 AM
kalesin kalesin is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2005
Posts: 10 kalesin User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 7 m 37 sec
Reputation Power: 0
Youre server

Use any tool for checking youre server. Maybe it doesnt working good or youre server admin has blocked robots.

Reply With Quote
  #3  
Old June 23rd, 2005, 06:16 PM
3-rx 3-rx is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Posts: 12 3-rx User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 53 m 24 sec
Reputation Power: 0
Quote:
Originally Posted by kalesin
Use any tool for checking youre server. Maybe it doesnt working good or youre server admin has blocked robots.


why? he isn't enought stupid to do it. i'll kill him :-) it's for funny.

i check headers. it's ok.
about robots, google is indexing my pages every day (and there are more than 20 robots ) who visiting this site every day (or week).
dns records are fine too.

if googlebot can visit, crawl and even index (only last week), why he cann't view homepage.
Quote:
January (when everything is ok)
Googlebot 30752+168 1.93 GB

April (my site was dropped)
[btw before this i add ~near 20mb content]
Googlebot 5440+65 380.26 MB

May
Googlebot 8709+47 648.51 MB

June (for 15 days)
Googlebot 11145+31 351.84 MB

the good progress is ,that G start crawling and indexation

23 Jun 2005 - 18:27
Googlebot 29965+59 1.01 GB

negative, that G still cann't view site canonical homepage in "www.domain.com" search. !
i guess, that's the reason why my KY-s don't work.
site:domain.com - 20-22 K results

Reply With Quote
  #4  
Old June 28th, 2005, 01:17 PM
Gnome101's Avatar
Gnome101 Gnome101 is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Dec 2004
Posts: 314 Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level)Gnome101 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 11 h 43 m
Reputation Power: 5
How old is the site, and how much SEO'ing have you done. Google could have black-listed you if they felt you've done too much to 'trick' the pages into good serps results.

Also, you could have headed into the sandbox, which is common for newer sites, and also put you way back down in the serps.

Reply With Quote
  #5  
Old June 28th, 2005, 11:43 PM
hasitha hasitha is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 120 hasitha User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 1 h 34 m 46 sec
Reputation Power: 6
if u have done your SEO properly then u must have ended up in the sandbox.happns to all new sites

Reply With Quote
  #6  
Old June 29th, 2005, 04:59 PM
3-rx 3-rx is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Posts: 12 3-rx User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 53 m 24 sec
Reputation Power: 0
Quote:
Originally Posted by hasitha
if u have done your SEO properly then u must have ended up in the sandbox.happns to all new sites


Quote:
How old is the site, and how much SEO'ing have you done. Google could have black-listed you if they felt you've done too much to 'trick' the pages into good serps results.

Also, you could have headed into the sandbox, which is common for newer sites, and also put you way back down in the serps.


site is 5-6 years old.

soe'ing .. hmm .. i don't did any spesial seoing. don't buy links, don't make any dooway or cloacking pages.

nothing special
only right titles, descriptions and some h1-h3 tags in the body of articles.

Quote:
negative, that G still cann't view site canonical homepage in "www.domain.com" search. !
i guess, that's the reason why my KY-s don't work.
site:domain.com - 20-22 K results
June 23rd, 2005 11:13 AM


site:domain.com: 26400
www.domain.com - sorry, no results

Reply With Quote
  #7  
Old July 1st, 2005, 12:07 PM
gnrlbzik gnrlbzik is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2005
Posts: 109 gnrlbzik User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 16 h 29 m 15 sec
Reputation Power: 4
ok for google www.domain.com and domain.com are two different things and two of those will be ranked and treated differently, a big exposure to new content, scares gbot, cause it remeber the rate your website was updated how much usually u add new content to it, so it is nice either to start with alot of info or gradualy increas the input of data, plus if you have made some changes to the website, layout wise, basically fulling around with html alot of layout, it will null your ranking due to this logic, unmatched html on some <Body> part will tell bot that major changes appeared and that it need to index you and rank you properly.


oh another thing, do you have dedicated hosting?

if such changes were made, or some chages to association of domain to host, u will probably were nulled, as you saying your website is 5-6 years old, so now it might take from 3-12 month for your site to index properly. Another thing is that you might use different domains in urls, such as http://www.examplecom
or www.example.com
or http://example.com
that creates spread association and boom, yeah

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > why Gbot visit my site, but don't index


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway