Scrapy
 | |
| Initial release | June 26, 2008 |
|---|---|
| Stable release | 0.24.4 / August 9, 2014 |
| Written in | Python |
| Operating system | Linux/Mac OS X/Windows |
| Type | Web crawler |
| License | BSD License |
| Website |
scrapy |
Scrapy is a web crawling framework with support for web scraping. It is open-source and written in Python. It is controlled using command line tools, that can be used to trigger the scrapers written in Python.
Scrapy was born at London-based web aggregation and e-commerce company Mydeco, where it was developed and maintained by employees of Mydeco and Insophia (a web consulting company based in Montevideo, Uruguay). In 2011, Scrapinghub (a web scraping consulting company based in Cork, Ireland and Montevideo; of which Mydeco is a customer) became the new official maintainer.[1] The first official release was in August 2008, and it has been continually improved since then.
References
- ↑ Pablo Hoffman (2013). List of the primary authors & contributors. Retrieved 18 November 2013.