Description

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Search this project


Versions

0.9
0.8
0.7

Short URLs

scrapy.readthedocs.org
scrapy.rtfd.org

Crate

This project has more information available about it on Crate!

Last Built

1 day, 8 hours ago

Repository

https://github.com/scrapy/scrapy.git

Home Page

http://scrapy.org/

Tags

parsing, xpath, crawling, scraping