#1
  1. No Profile Picture
    Contributing User
    Devshed Newbie (0 - 499 posts)

    Join Date
    Aug 2004
    Posts
    319
    Rep Power
    0

    Parallel::ForkManager - machine way tooo slow - need a quad-core machine


    tryin to get this to work:

    what is aimed: have a list of 300 to 400 urls - i need thumbnails of all of them:

    Duuu: do i need a 4 Core processor!?`

    tryin to get this to work:

    Q: do i need a 4 Core processor!?`

    why: well i am guessing that my machine is bit too solow hmmm i added Parallel::ForkManager.

    But if you do so - you need a blisteringly fast machine it uses lots of mb of memeory and a bunch of the core running opensuse 12.2 and perl 5.14.2

    my machine is too slow - whats if i want to run this with lemme say 200 URLS (or websites) do i need a 4 Core processor!?`




    PHP Code:

    #!/usr/bin/perl 
     
    use WWW::Mechanize::Firefox
    use 
    strict
    use 
    warnings
    #use Parallel::ForkManager;  

    #my $fork = Parallel::ForkManager->new(25); 
     
    #sites 
    my @urls qw(http://www.google.com http://www.yahoo.com http://www.cnn.com http://www.bing.com http://www.nbcnews.com/... and thosusand 

    others more ); 
    #temp base dir 
    my $temp '/home/aaron/cgi-bin/'
     
    for 
    my $each (@urls){ 
        
    #$fork->start and next; 
        
    my $mech WWW::Mechanize::Firefox->new(launch => 'firefox',create => 1,); 
         
        
    $each =~ /www\.(\w+)\.com/; 
        
    my $name = $1
        print 
    "creating $name.png\n"
         
         
        
    $mech->get($each); 
        
    my $png $mech->content_as_png(undefundef, {width => 240,height => 240}); 
         
        
    my $dir_name "$temp/$name".".png"
        
    open my $file">""$dir_nameor die "couldnt create $temp/$1.png"
        
    binmode $file
        print {
    $file$png
         
        
    close $file
        
    sleep 5# sleep some to give it a little time to make sure things compleated..... you'll need this more using fork 
         
        #$fork->finish; 

    print 
    "Well All done!\n"
    #$fork->wait_all_children; 
    Last edited by metabo; October 28th, 2012 at 09:11 AM.
  2. #2
  3. No Profile Picture
    Contributing User
    Devshed Newbie (0 - 499 posts)

    Join Date
    Aug 2004
    Posts
    319
    Rep Power
    0
    any idea - well how does the programme behave at your site?
  4. #3
  5. No Profile Picture
    Contributing User
    Devshed Intermediate (1500 - 1999 posts)

    Join Date
    Apr 2009
    Posts
    1,940
    Rep Power
    1225
    I concur with the answers you received on your perlmonks cross post.

IMN logo majestic logo threadwatch logo seochat tools logo