October 26th, 2012, 08:35 AM
|
|
Contributing User
|
|
Join Date: Aug 2004
Posts: 229
Time spent in forums: 2 Days 13 h 54 m 30 sec
Reputation Power: 0
|
|
|
Parallel::ForkManager - machine way tooo slow - need a quad-core machine
tryin to get this to work:
what is aimed: have a list of 300 to 400 urls - i need thumbnails of all of them:
Duuu: do i need a 4 Core processor!?`
tryin to get this to work:
Q: do i need a 4 Core processor!?`
why: well i am guessing that my machine is bit too solow hmmm i added Parallel::ForkManager.
But if you do so - you need a blisteringly fast machine it uses lots of mb of memeory and a bunch of the core running opensuse 12.2 and perl 5.14.2
my machine is too slow - whats if i want to run this with lemme say 200 URLS (or websites) do i need a 4 Core processor!?`
PHP Code:
#!/usr/bin/perl
use WWW::Mechanize::Firefox;
use strict;
use warnings;
#use Parallel::ForkManager;
#my $fork = Parallel::ForkManager->new(25);
#sites
my @urls = qw(http://www.google.com http://www.yahoo.com http://www.cnn.com http://www.bing.com http://www.nbcnews.com/... and thosusand
others more );
#temp base dir
my $temp = '/home/aaron/cgi-bin/';
for my $each (@urls){
#$fork->start and next;
my $mech = WWW::Mechanize::Firefox->new(launch => 'firefox',create => 1,);
$each =~ /www\.(\w+)\.com/;
my $name = $1;
print "creating $name.png\n";
$mech->get($each);
my $png = $mech->content_as_png(undef, undef, {width => 240,height => 240});
my $dir_name = "$temp/$name".".png";
open my $file, ">", "$dir_name" or die "couldnt create $temp/$1.png";
binmode $file;
print {$file} $png;
close $file;
sleep 5; # sleep some to give it a little time to make sure things compleated..... you'll need this more using fork
#$fork->finish;
}
print "Well All done!\n";
#$fork->wait_all_children;
Last edited by metabo : October 28th, 2012 at 09:11 AM.
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
