Development Software
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me
Go Back   Dev Shed ForumsWeb Site ManagementDevelopment Software

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old February 24th, 2004, 11:04 AM
johnnyhall81 johnnyhall81 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Feb 2004
Posts: 6 johnnyhall81 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
View all pages/links in a website

Hi guys,

I am working as a Software Test Engineer. Most of my time is spent testing our translated web applications in many different languages. Basically I click as many links as possible making sure the pages are displayed correctly.

Does anyone know of a tool that would display a clickable list of all the pages/links in a website? This way I could go through the pages one-by-one thus minimising the chance of missing a page.

Reply With Quote
  #2  
Old February 24th, 2004, 12:20 PM
drgroove's Avatar
drgroove drgroove is offline
pushing envelopes, not pencils
Dev Shed God 2nd Plane (6000 - 6499 posts)
 
Join Date: Feb 2002
Posts: 6,235 drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level)drgroove User rank is Captain (20000 - 30000 Reputation Level) 
Time spent in forums: 1 Day 6 h 23 m 38 sec
Reputation Power: 257
Mozilla Firefox. Visit any web page, right click, select "View Info", click the Links tab.
__________________
Give a person code, and they'll hack for a day; Teach them how to code, and they'll hack forever.
Analyze twice; hack once.
The world's first existential ITIL question: If a change is released into production without a ticket to track it,
was it actually released?


About DrGroove: ITIL-Certified IT Process Engineer - Enterprise Application Architect -
Freelance IT Journalist - Devshed Moderator - Funk Bassist Extraordinaire


Reply With Quote
  #3  
Old February 24th, 2004, 01:30 PM
johnnyhall81 johnnyhall81 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Feb 2004
Posts: 6 johnnyhall81 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Quote:
Originally Posted by drgroove
Mozilla Firefox. Visit any web page, right click, select "View Info", click the Links tab.


Hmm - This will display all the links but I am unable to copy the links in order to paste them into the address bar. Is there a similar solution that would allow me to click the links / or paste them into the address bar. It would be too tedius to manually type the links into the address bar.

Reply With Quote
  #4  
Old March 27th, 2008, 10:59 PM
alex298 alex298 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jul 2006
Posts: 19 alex298 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 9 m 56 sec
Reputation Power: 0
Hello,

You can write a simple program. At first glance, it seems to be not too difficult to do that. Actually this is a quite interesting program.

Best regards

Reply With Quote
  #5  
Old June 11th, 2008, 10:58 AM
theNbomr theNbomr is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: May 2008
Location: BC, Canada
Posts: 34 theNbomr User rank is Sergeant (500 - 2000 Reputation Level)theNbomr User rank is Sergeant (500 - 2000 Reputation Level)theNbomr User rank is Sergeant (500 - 2000 Reputation Level)theNbomr User rank is Sergeant (500 - 2000 Reputation Level)theNbomr User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 21 h 54 m 4 sec
Reputation Power: 8
This is a little late, but for the benefit of others reading this thread, you can create a simple perl script using the HTML::Parser module that will do exactly what you want. The examples on the CPAN (cpan.org) page should be a pretty good starting point.
The ubiquitous wget tool, with the --spider option will do the whole job, including clicking all of the links.
--- rod.

Reply With Quote
  #6  
Old June 4th, 2009, 07:17 AM
johnegood johnegood is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2006
Posts: 33 johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 4 h 15 m 16 sec
Reputation Power: 6
I had this same question and googled it, only to find myself on this thread.

You do NOT have to write code to figure out the pages on a website. Just use this tool called google. Enter in the google search bar:

site:www.domaininquestion.com

It will give you a list and a count of all the pages on the website.

Quote:
Originally Posted by johnnyhall81
Hi guys,

I am working as a Software Test Engineer. Most of my time is spent testing our translated web applications in many different languages. Basically I click as many links as possible making sure the pages are displayed correctly.

Does anyone know of a tool that would display a clickable list of all the pages/links in a website? This way I could go through the pages one-by-one thus minimising the chance of missing a page.

Reply With Quote
  #7  
Old June 4th, 2009, 07:21 AM
johnegood johnegood is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Jun 2006
Posts: 33 johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level)johnegood User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 4 h 15 m 16 sec
Reputation Power: 6
Oh yes, the links question.

It's unclear whether you care about incoming or outgoing links.

If it's outgoing links, this is a question that would be answered by a link checker. There are many free link checkers. They are quality tools.

If it's incoming links that you care about, this is more of a SEO type question. If you have control over the site, the most definitive answer can be gotten from this tool called google. (Again!). Set up the google webmaster tools and presto, they will provide you a comprehensive list of all of the incoming links organized by page that they link to. Free.

Again, no need to write code. perl or otherwise.

Reply With Quote
Reply

Viewing: Dev Shed ForumsWeb Site ManagementDevelopment Software > View all pages/links in a website


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump




 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 




© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 5 Hosted by Hostway
Stay green...Green IT