Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old April 26th, 2007, 05:12 AM
thomking thomking is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2007
Posts: 3 thomking User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 8 m 46 sec
Reputation Power: 0
Spiders, robots and crawlers?

can anyone explain what are spiders, robots and crawlers?
what these have to do with seo?. please reply me.

thanks in advance.

Reply With Quote
  #2  
Old April 26th, 2007, 09:45 AM
stymiee's Avatar
stymiee stymiee is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Nov 2003
Posts: 225 stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level)stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level)stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level)stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level)stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level)stymiee User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 20 h 48 m 23 sec
Reputation Power: 49
Quote:
Originally Posted by thomking
can anyone explain what are spiders, robots and crawlers?
what these have to do with seo?. please reply me.

thanks in advance.


They're all different names for the same thing. They don't affect SEO directly. The search engines use bots to crawl webpages to add to their index and then rank them. So you need to make sure your website is able to be crawled by bots if you want to be ranked in the search engines.

Reply With Quote
  #3  
Old May 2nd, 2007, 09:28 AM
thomking thomking is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2007
Posts: 3 thomking User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 8 m 46 sec
Reputation Power: 0
replying with thanks!!

Oh I see,
thanks stymiee,
thanks for your reply,
can anyone give info about SEO and what are all its uses?
needs reply.

thanks in advance.

Reply With Quote
  #4  
Old August 24th, 2007, 06:47 AM
thomking thomking is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Apr 2007
Posts: 3 thomking User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 8 m 46 sec
Reputation Power: 0
Me and brothers were decided to launch a content website next month. Already we have two content websites each having more than 600 a total of links in all search engines. But these sites are not producing that much revenue. So we have taken this decision. Both of them asked me to do the job of optimizing and they have given me a target of $100 in Google Adsense account withing 5 months. I am in a tight corner that I have to concentrate in my UG studies also. They both work for another private company. I really need help from SEO professionals and SEO specialist that How can I achieve the target they have given me? What are all the initial steps that I should follow? How to bring traffic from Google? whether using Keyword optimization, more contents or links. If your answer lies in anyone of these please explain me in detail! And most important question, On which topics I have write articles? Specify Which topic is top in world searches? Please I am expecting answers for all these questions! Thanks whole heartedly to those who render!

Reply With Quote
  #5  
Old August 29th, 2007, 01:15 AM
Catacaustic's Avatar
Catacaustic Catacaustic is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Location: A Land Down Under
Posts: 439 Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level) 
Time spent in forums: 5 Days 15 h 22 m 19 sec
Reputation Power: 68
While this forum is good for asking questions, if you're just starting out you need to do a LOT more research on this before just asking a general "how to do it?" question like this. It takes a lot of time, energy and work to get a site ranking well. Five months may be enough, it may not be. Depends on how much effort you can put into it over that time.

The best place to look and research is probably SEOChat so go there and hunt around. You can also ask questions on their forums.
Comments on this post
ran_dizolph agrees!

Reply With Quote
  #6  
Old August 31st, 2007, 02:34 AM
eimee eimee is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2006
Posts: 8 eimee User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 23 m 53 sec
Reputation Power: 0
Quote:
Originally Posted by thomking
can anyone explain what are spiders, robots and crawlers?
what these have to do with seo?. please reply me.

thanks in advance.


Google is a fully automated search engine that uses software known as "spiders" to crawl the web on a regular basis and find sites to add to our index. . Different search engines have different names for this.
A robots.txt file provides restrictions to search engine robots (known as "bots") that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages...

Reply With Quote
  #7  
Old August 31st, 2007, 03:16 AM
eimee eimee is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2006
Posts: 8 eimee User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 23 m 53 sec
Reputation Power: 0
Google is a fully automated search engine that uses software known as "spiders" to crawl the web on a regular basis and find sites to add to our index. . Different search engines have different names for this.

Usually when the Googlebot finds a page, it reads all the links on that page and then fetches those pages and indexes them. This is the basic process by which Googlebot "crawls" the web.


A robots.txt file provides restrictions to search engine robots (known as "bots") that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages...

Let me know any confusion....
web development Company

Reply With Quote
  #8  
Old August 31st, 2007, 08:29 PM
dominoman's Avatar
dominoman dominoman is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2004
Location: london
Posts: 332 dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 1 Day 6 h 1 m 54 sec
Reputation Power: 37
Send a message via MSN to dominoman
Just to add to what eimee said, if you want to exclude some pages from the crawlers (for example some pages that you are using just to organise your own files) then you need to edit the robots.txt file on your web server.
__________________
Interested in online gaming? Access full reviews of all UK Online casinos here.

Roulette Strategy |William Hill | Viurgin | Jackpot joy

Reply With Quote
  #9  
Old August 31st, 2007, 08:42 PM
tj_nt tj_nt is offline
Contributing User
Dev Shed Intermediate (1500 - 1999 posts)
 
Join Date: Feb 2004
Posts: 1,731 tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level)tj_nt User rank is Major General (70000 - 90000 Reputation Level) 
Time spent in forums: 1 Month 1 Week 4 Days 15 h 19 m 8 sec
Reputation Power: 717
Quote:
Both of them asked me to do the job of optimizing and they have given me a target of $100 in Google Adsense account withing 5 months


The best way to increase revenue via Google Adsense is by developing viable (unique) content...

What is the content subject of your sites?

Reply With Quote
  #10  
Old September 1st, 2007, 05:38 AM
jg_abad's Avatar
jg_abad jg_abad is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2007
Posts: 94 jg_abad User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 52 m 8 sec
Reputation Power: 2
all three are same thing, this is the progamm which find your site and store your site's information to search engine's database.

Reply With Quote
  #11  
Old September 5th, 2007, 06:16 AM
WebKing WebKing is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Feb 2007
Posts: 37 WebKing User rank is Corporal (100 - 500 Reputation Level)WebKing User rank is Corporal (100 - 500 Reputation Level)WebKing User rank is Corporal (100 - 500 Reputation Level)WebKing User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 9 h 34 m 46 sec
Reputation Power: 3
Send a message via ICQ to WebKing
I think to delve deeper into the SEO in just 5-6 months you need lots and lots of reading about the subject itself and experimenting with what you are reading to get it affirm. There are lots of myths about seo spreaded all over the net, so be careful while applying whatever you read. Many newbies fall in danger [I mean their site got banned] while applying some unethical/black hat seo techniques. Though seo is a challenging and interesting thing, I liked experimenting with it and finding out what search engines are up to.

Reply With Quote
  #12  
Old September 22nd, 2007, 01:53 PM
dominoman's Avatar
dominoman dominoman is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2004
Location: london
Posts: 332 dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level)dominoman User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 1 Day 6 h 1 m 54 sec
Reputation Power: 37
Send a message via MSN to dominoman
And most of all get some high quality links. If you would like to get started feel free to place a link from one of my two sites: www.1st-casinos.co.uk and www.spreadbetting-uk.co.uk. The ADD URL link is at the bottom of the page.

Good luck with the SEO. Its rewarding when you start to see the results and your traffic goes up.

Reply With Quote
  #13  
Old September 28th, 2007, 01:52 PM
jazajay jazajay is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jul 2007
Posts: 336 jazajay User rank is Sergeant (500 - 2000 Reputation Level)jazajay User rank is Sergeant (500 - 2000 Reputation Level)jazajay User rank is Sergeant (500 - 2000 Reputation Level)jazajay User rank is Sergeant (500 - 2000 Reputation Level)jazajay User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 3 Days 6 h 16 sec
Reputation Power: 9
If you want to do well in PPC on a small budget you need to hit the long tail.

The long tail is the more specialized keywords that have less competition and are searched a lot less. This means more relevant searches from people looking for exactly the stuff you want to sell/service you want to offer hence higher conversion rates.

For example if you sell ecommerce services you could waste your budget on high priced keywords like ecommerce, or e-commerce bare in mind these are 2 different terms, or you could go for ones like ecommerce solutions or unique e-commerce soultions You have to do your keyword selection to decide whats best for you and your site. Don't use ecommerce solutions if you don't offer ecommerce services

This way you will maximize your ROI on a budget.

Other wise check out the seochat forum or buy a book, but I would do both.

Hope it works out.

Jaza

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > Spiders, robots and crawlers?


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump