|
|||||||||
|
|||||||||
| |||||||||
|
|||||||||
|
|||||||||
| |||||||||
|
|
|
| |||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
Dev Shed Forums Sponsor:
|
|
Stop making mediocre tutorials.The best tutorials are video! Camtasia Studio makes it easy to create engaging, buzz-building screen videos at any size, in any popular format. Download the free trial!
|
|
#1
May 3rd, 2008, 12:47 PM
|
|||
|
|||
|
I can't crawl on a web page which is using POST
How can I capture the html code from a public / free website which is using POST in the form field?
If I right click and "view source", I can see the html. How do I save this and /or is there a module in cpan? Thanks
|
|
#2
May 3rd, 2008, 02:27 PM
|
||||
|
||||
|
I think there could be something missing from your question, what exactly is it you're trying to do, if it's just sucking down the html, you can simply use wget, but I don't think that's what you're after ...
__________________
--Ax without exception, there is no rule ... The great thing about Object Oriented code is that it can make small, simple problems look like large, complex ones  09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0 Some people, when confronted with a problem, think "I know, I'll use regular expressions." Now they have two problems. -- Jamie Zawinski
|
|
#3
May 3rd, 2008, 04:47 PM
|
|||
|
|||
|
I tried wget from the command line and the entire content of the html page did not display. It's populating it from a database...I think.
The complete page loads into notebook when I right click and view souce. Quote:
|
|
#4
May 3rd, 2008, 07:06 PM
|
||||
|
||||
|
I'm still not sure your question is stated properly. It sounds like you are asking for just the HTML for the form, but since you mentioned POST in the subject, I think you want to post data and get the resulting page.
Either way, you need to use LWP or maybe Mechanize. There are some examples here of posting with LWP. Come back with specific problems. Edit: Here's one I remember: previous thread Last edited by keath : May 3rd, 2008 at 07:12 PM.
|
|
#5
May 4th, 2008, 07:03 PM
|
||||
|
||||
|
Code:
I tried wget from the command line and the entire content of the html page did not display. It's populating it from a database...I think. The complete page loads into notebook when I right click and view souce. In my experience, if the complete source code appears in your browser then the complete source code will be in your variable with Axweildr's method. You might need to deal with your line breaks before you output it since you will also have those in your variable.
__________________
print qq|Here I am\n| unless -e 'mySocialLife';
|
|
| Viewing: Dev Shed Forums > Programming Languages > Perl Programming > I can't crawl on a web page which is using POST |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
 |
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
