Web - Scrape

About

scraping is the extraction of data from a web page.

Articles Related

Technology

• Manual via Browser - Userscript (user.js)
• Automated via a Web - Robots (Wanderers | Crawlers | Spiders)

Web site to scrap

This website can be scrapped without penalty.

• http://toscrape.com/
• http://scraping-challenge-2.herokuapp.com/ (from scraproxy)

Library

Every library that permits to traverse/query the DOM of an HTML page will permit you to scrape/extract content.

Example:

• https://scrapy.org/ - Python
• http://scrapoxy.io/ (proxy for scrapper written in Node that starts VM with proxy in the cloud)