April 19th, 2000, 01:43 PM
Well I have a little problem with a script. I want to write something like a spider in PHP. But the problem is when I enter an url in a text box to submit, he don't know the uri of this url ... And I don't know how I can write a script which can find the default main page of an url. I think for the next steps I have no problems. But the other problem is how can I fallow all the links in the default main page that are in the same domain class ? Like www.nobug.lu, he finds out that the default main file is index.php3 and then he has to fallow all the links in the file which are in the same domain class (everything with nobug.lu ...) when there is a link e.g. webdev.lu he is not going to fallow it, he will ignore it. And then I want to have the text in the file in a database but that's no problem.
So my questions are, how can I find out the uri of an url and how can I fallow the links in a file that are in the same domain class.
When you can help me, that were very fine.
Laroche David <firstname.lastname@example.org>
NoBug Web Development