Scrapy

Scrapy is a fast and powerful web scraping library written in Python. The framework makes it easy to crawl and extract structured data from the web services. Scrapy can be used for a wide range of purposes, ranging from data mining to service monitoring. Scrapy is maintained by Zyte and is released as free and open source software.