|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
What do search engine bots/crawlers/spiders crawl when they're looking for pages to index on your site?
My understanding was that these crawlers indexed your web pages on your server as if your page was viewed in a text editor and not what is displayed to browsers (after server processing). Is this correct? Do the crawlers see your pages with server side includes as one file (like the browser does) or does the crawler index your page making special note of your linked .css/.js files and SSIs and crawl them shortly afterwards but not as part of the index of the main page that called them? Thanks much!!! |
|
#2
|
||||
|
||||
|
Yep.
SSI are executed on the server, so the SE will see the finalized page - not the SSI itself. You might want to block the directory that you store your SSI files in from robots though...as you don't want these files indexed individually.
__________________
Cheers, Jamie # mdb4u | mobile movie database] | Please help to test and promote # skiFFie | Home of the 'accessibility module' for Drupal # Jamie Burns [me] Accessibility Module [drupal] # guidelines | search | wap resources | not getting help | fold to cure __________________ Let the might of your compassion arise to bring a quick end to the flowing stream of the blood and tears ..... Please hear my anguished words of truth. ![]() __________________ |
![]() |
| Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > SEO & SSI Question? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|