Hire A Programmer
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me

The Shed is going Social! Join us on FaceBook and Twitter and chime in on the conversation.

Go Back   Dev Shed ForumsOtherHire A Programmer

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Dev Shed Forums Sponsor:
  #1  
Old December 2nd, 2012, 09:08 PM
mhsiao45 mhsiao45 is offline
Registered User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Aug 2007
Posts: 29 mhsiao45 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 56 m 26 sec
Reputation Power: 0
Website Tracking Program

Hi,

I would like to see if anyone is interested.
Let me know what you think, and how much you would charge.
You can PM me your price.

HERE IS MY ORIGINAL QUESTION BELOW:



I was hoping someone could help out.

Is there a way to track certain changes to other websites?

I work for a manufacturers sales rep firm. Ideally, we want to rep the best manufacturers'. If you can imagine, the best are usually already taken, unless that manufacturer feels that rep firm isn't doing well for them. At that point, the rep firm gets dropped, and usually the rep firm will remove them from their website.

Thats where we want to take action and pick up these manufacturers while they are open. However, its very hard to find out without constantly checking every rep firms website. Either that, or just word of mouth.

It would be great if there was a way to track the removal of say, certain links (manufacturer's links) or images from a certain web page. Ideally, we would want to get notified when a change occurs, and then we can go see what link was removed.


For example, thsi rep firm lists all their Manufacturers here:
http://www.yando.com/caline.htm

Say CREE Microwave is removed. We would want some way to be notified when that happens.

Any ideas on how to achieve this?


ANOTHER MEMBERS APPROACH:

This would not necessarily need PHP. If I were doing this I would periodically grab the pages of interest and store them somewhere. I'd then do a diff on the latest page and the corresponding previously stored page. I would then analyze those diff's and make the appropriate notifications.

As a matter of personal preference I would use perl to do this.

Reply With Quote
  #2  
Old December 3rd, 2012, 03:33 PM
hdewantara's Avatar
hdewantara hdewantara is offline
Contributing User
Dev Shed Newbie (0 - 499 posts)
 
Join Date: Oct 2009
Location: Jakarta, Indonesia.
Posts: 149 hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level)hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level)hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level)hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level)hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level)hdewantara User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 1 Day 18 h 50 m 40 sec
Reputation Power: 30
Send a message via MSN to hdewantara
Hi mhsiao45.
Don't know Perl much, its language-syntax is much harder than PHP. But I'm sure PHP is sufficient for your project.

First, you might need PHP's CRON job to run a regular check on those pages.

And this would be easier if those are of common type of web pages (static ones, not heavily loaded with dynamic javascript coding). You might have heard of PHP cURL to grab these difficult pages. This is the 2nd.

Third, to compare strings. I think there are some PHP large-strings comparison libs out there you could adapt...

Hendra

Last edited by hdewantara : December 3rd, 2012 at 03:37 PM.

Reply With Quote
Reply

Viewing: Dev Shed ForumsOtherHire A Programmer > Website Tracking Program

Developer Shed Advertisers and Affiliates



Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 


Powered by: vBulletin Version 3.0.5
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.

© 2003-2013 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap