Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb DesignSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old January 20th, 2004, 01:12 PM
dani boy dani boy is offline
Junior Member
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jan 2004
Location: Brazil
Posts: 5 dani boy User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Thumbs up extract links from all pages of a website

Hi there,

I work with translations services and sometimes I need to extract all pages from a website in order to provide clients a quote based on word amount. I have used these "Website mappers" but it doesn't work, it extracts only the main page, so I have to access the others page one by one.

A guy told me that it is because the top menus in most new sites contain in a flash file (.swf) and spider programs can not process flash binary files also complex java scripts, java applet, cookies. etc..

Does anybody know a software that could do it?

Regards,

Dani

Reply With Quote
  #2  
Old October 13th, 2004, 02:38 PM
dejaone dejaone is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Mar 2004
Posts: 300 dejaone User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 8 h 7 m 22 sec
Reputation Power: 5
you can easily write a php or perl script to do the job if you know basic programming

Reply With Quote
  #3  
Old October 24th, 2004, 02:02 PM
siruis siruis is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2004
Posts: 4 siruis User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Talking best program I found

The best program I found is on USA freeware Get it at: http://www.usafreeware.com/content/view/229/34/
This little baby will get just about the entire internet with one sweep! And settings will let you extract links and download file as well as create a word list! Pluse when you are done you can surf the site on your computer while you are offline!


Quote:
Originally Posted by dani boy
Hi there,

I work with translations services and sometimes I need to extract all pages from a website in order to provide clients a quote based on word amount. I have used these "Website mappers" but it doesn't work, it extracts only the main page, so I have to access the others page one by one.

A guy told me that it is because the top menus in most new sites contain in a flash file (.swf) and spider programs can not process flash binary files also complex java scripts, java applet, cookies. etc..

Does anybody know a software that could do it?

Regards,

Dani

Last edited by siruis : October 24th, 2004 at 02:04 PM. Reason: Insert a Hyper link

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb DesignSearch Engine Optimization > extract links from all pages of a website


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 6 hosted by Hostway