Dev Shed Lounge
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed Forums > Other > Dev Shed Lounge
Reload this Page

Search engines and Dynamic websites...

Discuss Search engines and Dynamic websites... in the Dev Shed Lounge forum on Dev Shed.
Search engines and Dynamic websites... Dev Shed Lounge forum discussing anything that doesn't fit into the other forums. This is a place to relax, talk, and even have some friendly debate. Walk softly and carry a big wiffle bat.

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
Lose your application development headaches. Start developing and deploying applications with Advantage Database Server today. Download a 30-day trial for Free!
  #1  
Old July 18th, 2001, 07:36 AM
Sheriff's Avatar
Sheriff Sheriff is offline
Oheim
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Jun 2001
Location: Austria
Posts: 69 Sheriff User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 7
Search engines and Dynamic websites...
Hy-
I was wondering....

how do spiders treat dynamic websites? What I mean is this:
A URI like this one:
http://forums.devshed.com/newthread.php?s=&action=newthread&forumid=26

usualy isn't indexed by spiders, at least I was told so!, can anybody tell me if that is true?
And if so, why?

All they do is to open a http connection and then parse links, right? So I don't see a reason why spiders couldn't follow a link like the above one.

so... I am confused (
maybe you guys know the answere I am looking for.

Thanks a lot!
Sheriff
__________________
There are two major products that come out of Berkeley: LSD and UNIX. We don't believe this to be a coincidence.

God is just hacker who rooted the world!
Reply With Quote
  #2  
Old July 18th, 2001, 08:38 AM
rod k rod k is offline
Apprentice Deity
Dev Shed Loyal (3000 - 3499 posts)
  
Join Date: Jul 1999
Location: Niagara Falls (On the wrong side of the gorge)
Posts: 3,237 rod k User rank is Private First Class (20 - 50 Reputation Level)rod k User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 m 8 sec
Reputation Power: 12
Send a message via AIM to rod k
Most spiders won't crawl pages with a ? in the URL.

The reason is that the search engine designers believe that if the URL has a dynamic element then the data harvested from the page is more likely to be inaccuarate at a future date than a static page.
__________________
FSBO (For Sale By Owner) Realty
Reply With Quote
  #3  
Old July 18th, 2001, 08:51 AM
Sheriff's Avatar
Sheriff Sheriff is offline
Oheim
Dev Shed Newbie (0 - 499 posts)
  
Join Date: Jun 2001
Location: Austria
Posts: 69 Sheriff User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 7
This means, that if you use a content management system, you have a disadvantage...
Kinda s*****... doesn't it?

Is there a workaround?
Reply With Quote
  #4  
Old July 18th, 2001, 10:38 AM
rod k rod k is offline
Apprentice Deity
Dev Shed Loyal (3000 - 3499 posts)
  
Join Date: Jul 1999
Location: Niagara Falls (On the wrong side of the gorge)
Posts: 3,237 rod k User rank is Private First Class (20 - 50 Reputation Level)rod k User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 m 8 sec
Reputation Power: 12
Send a message via AIM to rod k
Reply With Quote
Reply

Viewing: Dev Shed Forums > Other > Dev Shed Lounge > Search engines and Dynamic websites...

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

 Free IT White Papers!
 
Accelerating Trading Partner Performance
One in five. That's how many partner transactions have at least one error. That is an amazing statistic, particularly given the extraordinary leaps in innovation across the global supply chain during the past two decades. Download this white paper to learn more.
 
Competing on Analytics
This Tech Analysis is designed to help identify characteristics shared by analytics competitors, and includes information about 32 organizations that have made a commitment to quantitative, fact-based analysis.
 
Cost Effective Scaling with Virtualization and Coyote Point Systems
An overview of the industry trend toward virtualization, how server consolidation has increased the importance of application uptime and the steps being taken to integrate load balancing technology with virtualized servers.
 
Five Checkpoints to Implementing IP Telephony
Implementation planning for IP PBX software and IP telephony has become vital as businesses replace discontinued legacy PBX phone systems. This informative whitepaper outlines five "checkpoints" for any implementation plan that will help make IP communications a successful proposition.
 
Hosted Email Security: Staying Ahead of New Threats
In the last two years, email has become a fierce battleground between the nefarious forces of spam and malware, and the heroes of messaging protection. The spam volumes increased alarmingly every month, bringing clever new forms of phishing and virus propagation attacks.
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway.