| Initial release | June 26, 2008 |
|---|---|
| Stable release | 0.14 / November 17, 2011 |
| Written in | Python |
| Operating system | Linux/Mac OS X/Windows |
| Type | Web crawler |
| License | BSD License |
| Website | scrapy.org |
Scrapy is a web crawling framework, which was designed for web scraping. It is open-source and written in Python. It is controlled using command line tools, that can be used to trigger the scrapers written in Python.
Scrapy was born in MyDeco [1], a UK startup. It soon became maintained, extended and improved by Insophia and Mydeco employees. The first official release was in August, 2008, and it has been continually improved since then.