Scraping Links With PHP
By Justin Laing2008-01-06
What Else Could I Do With This Thing?
|
|
The possibilities are limitless. For starters you might want to store a list of sites that you want scraped in a database and then set up the script so it runs on a regular basis to scrap those sites. You could then compare the link structure over time or maybe republish the links in some sort of directory. Leave a comment below and say what you’re using this script for. Here are a few other things people have done with scrapers in the past:
- Build a search engine from the content you gather. Google
- Analyze a site to determine how well it is SEO optomized for keywords. SEO Book’s Keyword Density Tool.
- Republish free content dynamically on your website.
- Create an RSS feed from a website. Using PHP To Scrape Web Sites As Feeds
Tutorial Pages:
» Scraping Links With PHP
» Get The Page Content
» Tip: Fake Your User Agent
» Using PHP’s DOM Functions To Parse The HTML
» XPath Makes Getting The Links You Want Easy
» Iterate And Store Your Links
» Your Completed Link Scraper
» What Else Could I Do With This Thing?
» Is Scraping Content Legal?
Originally posted on Makebeta
|
