#1
  1. No Profile Picture
    Junior Member
    Devshed Newbie (0 - 499 posts)

    Join Date
    Jan 2004
    Location
    Brazil
    Posts
    5
    Rep Power
    0

    extract all links from all pages of a website


    Hi there,

    I work with translations services and sometimes I need to extract all pages from a website in order to provide clients a quote based on word amount. I have used these "Website mappers" but it doesn't work, it extracts only the main page, so I have to access the others page one by one.

    A guy told me that it is because the top menus in most new sites contain in a flash file (.swf) and spider programs can not process flash binary files also complex java scripts, java applet, cookies. etc..

    Does anybody know a software that could do it?

    Regards,

    Dani
  2. #2
  3. Moderator Emeritus
    Devshed Supreme Being (6500+ posts)

    Join Date
    Feb 2002
    Location
    Austin, TX
    Posts
    7,186
    Rep Power
    2265
    Have you checked Hotscripts? Sounds like something that would be on there... (link in sig if you're unfamiliar w/ HS)
    DrGroove, Devshed Moderator | New to Devshed? Read the User Guide | Connect with me on LinkedIn

IMN logo majestic logo threadwatch logo seochat tools logo