Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old June 3rd, 2006, 02:58 AM
pmlbowt pmlbowt is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Posts: 64 pmlbowt User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 57 m 6 sec
Reputation Power: 4
Crawler cookie

Do crawler's keep track of cookies on websites by any chance?

Right now a site I am designing has a version that uses flash for various parts and a version that uses only html. When a user first goes to the site they are taken to a landing page where they choose which version they want to use (choice is saved in a cookie). after that the entire site is run off the index.php page, which basically has the following logic:

Code:
if (isset ($_COOKIE['site_version']))
{
   if ($_COOKIE['site_version'] == 'flash')
   {
   	  require_once ("flash_index.php");
   }
   else
   {
   	  require_once ("html_index.php");
   }
}
else
{
    require_once ("choose.php");
}


so if crawler's do not keep track of cookies they will not be able to get past the choose.php page right?

seems the only way around this would be to detect if the visitor is a crawler (using getenv("HTTP_USER_AGENT")), but I have heard that serving up different data for when a crawler visits is a big no-no.

does anyone have any suggestions?

Reply With Quote
  #2  
Old June 8th, 2006, 02:56 AM
Catacaustic's Avatar
Catacaustic Catacaustic is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2005
Location: A Land Down Under
Posts: 442 Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level)Catacaustic User rank is Second Lieutenant (5000 - 10000 Reputation Level) 
Time spent in forums: 5 Days 15 h 53 m 40 sec
Reputation Power: 68
Your first question is easy. SE robots do NOT read cookies and any info that's stored in them will never be used by these robots.

As far as what do do about this, judging by the code that you've got set up there, you "should" be alright. The bots will be served with the "choose.php" page, and then they'll have the chance to spider from there. Of course, if every page on your site relies on cookies, you will have some big headaches.

Reply With Quote
  #3  
Old June 8th, 2006, 02:54 PM
G00SE's Avatar
G00SE G00SE is offline
.... escape ....
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2004
Posts: 448 G00SE User rank is Sergeant (500 - 2000 Reputation Level)G00SE User rank is Sergeant (500 - 2000 Reputation Level)G00SE User rank is Sergeant (500 - 2000 Reputation Level)G00SE User rank is Sergeant (500 - 2000 Reputation Level)G00SE User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 3 Days 19 h 42 m 8 sec
Reputation Power: 11
Why not just have:

mysite.com/flash/

mysite.com/html/
__________________

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > Crawler cookie


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway
Stay green...Green IT