Gbot does not index fully

My site is more then 1 year old and I have around 300.000 pages all mod-rewriten but Gbot has only indexed 33.000 pages for over a year now. All my pages are around 20 kb and the connection is very fast, I do maintain the server myself but I cant figure out why I dont get fully indexed, any ideas? site = www.bogaa.org

Not a very legal site there I'd imagine...? :\

it is legal in my country! Anyway google does index other sites like mine fully, please a serious answer.

I disagree back because it has indexed 33.000 pages, if it was a non alowed site they would have removed my site entirely dont you think?

No because that's the nature of the web... I don't think GoogleBot has the ability to decide what is right and wrong as it's an automatic tool for collecting data on request. And the staff at Google probably can't effectively police the billions of websites that it lists.

Legalities aside, you have no meta data, you don't use headers and you don't target keywords. The site is effectively not very search engine friendly in my opinion.

Thanks for the info, though I didnt know google required metadata or headers for that matter, will try to find more info, again tnx

No google doesn't look at the meta deta, it targets keywords within the site content like page titles, headers, alt text on images etc.

I see, I did check the headers and it seems like it does send out headers

It does look at meat data, it does not require it, it is not relevant as much as keywords with in the content, and it is also not relevant as much as html to text ration. The simple rule, keep your meta data short and on point, same rule apply to the links and it titles of the links and basically to everything else.

the idea is to get a mix of everything in right amounts, ingredients stay the same the difference is how much u put in it, logically u want less code and less text, but you want text/content to properly target a specific area/environment with out hitting many different targets its much harder to achieve with bigger websites, but that’s where appropriate links come into play from the other websites to yours and the combination of them.

but back to the indexing, well from my experience, bots have indexing limits that are changed every so often depending on usability of the website, and how the information is relevant to its search inquiries, and it makes sense, plus many other predetermine things.

It seems like I have all these things done but still nothing, ive seen other sites with dynamic title generators but they do get fully indexed, maybe I need to hammer google more often?

u cant hammer it, it will come to you. how often do you update your website?

ok first of all u dont have much of the searchable content, its bunch of words seperated by html code, here is one little example, your titles of the pages dont have any usefull info, who searches for 77773453? its fine to have dinamicly generated website, it doesnt metter it all comes out as html page to bot, content does not include single words contect is couple of paragraphs, well at list couple of sentances, there are no combinations of searchable keywords, man i can point out **** load of things, but just look at your website use logic.

Thanks man you have opened my eyes, I will start working on it today, what if I changed the titles from stats to the name of a certain file ex. "bogaa torrents > showing details for The Matrix" etc.. Again thanks a lot for the great responses.

look, logic is simple in here, u have bunch of links many of them are single words, plus those links lead to files, files that do not represent anything to the google, meaning it leads to the dead end for the gbot, no wonder it doesnt want to index more pages, the only files it would index is pdf, xl, txt, and other txt files. for users well they might find something they are looking for, through your site, but when searching, there nothing really to index, basically google does a favor for you by even indexing what is indexed, and thats it. plus take a look at the links u at list could have link title with some information on what that file is, for example how big it is, is it a movie, here are the examples.