Scrapy

A high-level Web Crawling and Web Scraping framework

Web CrawlingOpen Source Developer ToolsOpen Source