|
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
Please check if I'm doing right
Hi all!
I would like to exclude only my forum (vbulletin) folder, from crowler, Code:
User-agent: * Disallow: /forum/ and do I put robots.txt in forum folder or root? thanx |
|
#2
|
|||
|
|||
|
your website's root directory
|
|
#3
|
|||
|
|||
|
thanx happyallday,
I guess I'm on the right track ![]() |
![]() |
| Viewing: Dev Shed Forums > Web Design > Search Engine Optimization > Please check if I'm doing right |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|