#1
  1. No Profile Picture
    Registered User
    Devshed Newbie (0 - 499 posts)

    Join Date
    Nov 2017
    Location
    Denmark
    Posts
    1
    Rep Power
    0

    crawling data contents from the internet then putting them in a place to used at a la


    am new to php , who can help on gathering news from various news websites, then storing it in a database? I have no clue on where to even begin.
  2. #2
  3. Maddening Moderator
    Devshed Supreme Being (6500+ posts)

    Join Date
    Mar 2007
    Location
    Washington, USA
    Posts
    16,459
    Rep Power
    9645
    Learn about spiders and how it might be illegal for you to use one the way you've described.
  4. #3
  5. Registered User
    Devshed Newbie (0 - 499 posts)

    Join Date
    Oct 2017
    Location
    Lithuania
    Posts
    25
    Rep Power
    0
    In short: you will need to use PHP (with curl and HTML DOM parsing functions) and MySQL for that. Usually, it's not a difficult task (might be a bit tricky if websites you want to scrap content from use additional authorizations, verifications, etc.), but if you have no experience so far, be ready to spend at least a week or so...

IMN logo majestic logo threadwatch logo seochat tools logo