|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
Can a search BOT access this portion of my site?
can search engine bots hit https? I have about 30 pages of content that were originally written and saved in PDF format. The 30 pages of information is only available to paid members who have to log into our site. So my question is, if I convert all of this can a search engine bot get in and read this or will I have to make a link like <a href="link_to_content"></a> so that it is only visible through code? Will that method even work? Thanks again for the help.
|
|
#2
|
||||
|
||||
|
In answer to your question, I think that some bots can read https:// documents, the same way that they can read and decypher PDF and Word documents.
But... If the content is only viewable by members after they have logged in, then it doesn't matter if it's http:// or https:// bots won't be able to get to it. Basically, if a person can't get to it without logging in to access the information, then a bot won't be able to either. |
|
#3
|
||||
|
||||
|
Yes, as what has been mentioned by Catacaustic, pages that require log-ins will not be read by the bots. Adding a link to those pages will not help either if users are prompted for passwords upon keying in the urls directly.
Please don't mind me asking.. if your valuable content is only for your members, why make it available through search engines ![]() |
|
#4
|
|||
|
|||
|
hi,
you have made pdf pages for paid members which is not meant for any free members. as you have created pages only for paid members and are restricted, the bot won't enter in to those pages. if crawler visit those pages all informations will be opened. if you are looking all these things accrding to search engine point of view then at least you will have to make the information open for all. if access of visitors is prohibited then access of search engines may not be there. if some thing is very personal it should not be disclosed to search engines.
__________________
E-commerce website design and SEO web promotion company UK Software Development Cad Services |
|
#5
|
|||
|
|||
|
SE bots should not be able to crawl paid members areas
|
|
#6
|
||||
|
||||
|
Quote:
Yes they do not.I had a long debate on this in a different forum. If a normal guest can't access your webpage then even bots won't. |
|
#7
|
|||
|
|||
|
Quote:
Well my search engine's webspider could read a pdf file but it will not venture across a https: area so in my case it wouldn't get indexed and if it is behind a passowrd protected area then it wouls also not go through it either. |
![]() |
| Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > Can a search BOT access this portion of my site? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|