April 10th, 2009, 04:56 PM
Spider that uses mysql
I'm looking for a web crawler that will spider my site and toss the urls and page content into a mysql database so that database can , in turn, be indexed by Sphinx Site Search.
Not wanting to reinvent the wheel, I'm wondering if anyone knows of a code snippet that will do this or can point me towards a tutorial.
April 10th, 2009, 07:27 PM
Google is your friend:
True happiness is not getting what you want, it's wanting what you've already got.