1. No Profile Picture
    Devshed Newbie (0 - 499 posts)
    Hi everybody,

    I'm trying to find a decent perl script for grabbing entire sites off the web (should be able to create browsable copies with localized links, etc.).

    I've got Leitner's WebMirror and it should do exactly what I need, but for some reason it refuses to follow links from the 'root' page, which renders it useless (the same single page can be fetched with a simple one liner).

    Anybody with experience on using similar scripts or modules, please comment. I wouldn't want to write the whole thing myself as my Perl skills are poor

    Thanks in advance,
  2. #2
  3. No Profile Picture
    Devshed Newbie (0 - 499 posts)
    Check out the module documentation.

    perldoc lwpcook

    There is a mirror routine call. It works OK when I've used it.

IMN logo majestic logo threadwatch logo seochat tools logo