ScraperWiki
| ScraperWiki | |
|---|---|
 | |
| Web address | scraperwiki.com |
| Slogan | ScraperWiki is a platform for doing data science on the web |
| Available in | English |
Content license | Affero General Public License[1] |
| Revenue | Sponsored by 4iP[2] |
Alexa rank |
 133,089 (April 2014)[3] |
| Current status | Active |
ScraperWiki is a web-based platform for collaboratively building programs to extract and analyze public (online) data, in a wiki-like fashion. "Scraper" refers to screen scrapers, programs that extract data from websites. "Wiki" means that any user with programming experience can create or edit such programs for extracting new data, or for analyzing existing datasets.[2] The main use of the website is providing a place for programmers and journalists to collaborate on analyzing public data.[4][5][6][7][8][9]
Scrapers
Scrapers are created using a browser based IDE or by connecting via SSH to a server running GNU/Linux. They can be programmed using a variety of programming languages, including Perl, Python, Ruby, JavaScript and R.
History
ScraperWiki was founded in 2009 by Julian Todd and Aidan McGuire. It was initially funded by 4iP, the venture capital arm of TV station Channel 4. Since then, it has attracted an additional £1 Million round of funding from Enterprise Ventures.
Francis Irving is the Chief Executive Officer of ScraperWiki.[10]
See also
- Data driven journalism
- Web scraping
References
- ↑ "ScraperWiki Terms and Conditions".
- ↑ 2.0 2.1 Jamie Arnold (2009-12-01). "4iP invests in ScraperWiki". 4iP.
- ↑ "Scraperwiki.com Site Info". Alexa Internet. Retrieved 2014-04-01.
- ↑ Cian Ginty (2010-11-19). "Hacks and hackers unite to get solid stories from difficult data". The Irish Times.
- ↑ Paul Bradshaw (2010-07-07). "An introduction to data scraping with Scraperwiki". Online Journalism Blog.
- ↑ Charles Arthur (2010-11-22). "Analysing data is the future for journalists, says Tim Berners-Lee". The Guardian.
- ↑ Deirdre McArdle (2010-11-19). "In The Papers 19 November". ENN.
- ↑ "Journalists and developers join forces for Lichfield ‘hack day’". The Lichfield Blog. 2010-11-15.
- ↑ Alison Spillane (2010-11-17). "Online tool helps to create greater public data transparency". Politico.
- ↑ From CMS to DMS: C is for Content, D is for Data from the ScraperWiki Data Blog