80legs

80legs
URL www.80legs.com
Type of site Web Crawling Service
Available language(s) English
Owner Computational Crawling, LP
Created by Shion Deysarkar
Launched September 2009
Current status Privately Owned

80legs is a web crawling service that allows its users to create and run web crawls through its software as a service platform.

Contents

History

80legs was created by Computational Crawling, a company in Houston, TX. The company launched the private beta of 80legs in April 2009 and publicly launched the service at the DEMOfall 09 conference. At the time of its public launch, 80legs offered customized web crawling services. It has since added subscription plans and other product offerings[1] [2].

Technology

80legs is built on top of a distributed grid computing network, provided by a separate company[3]. This grid consists of approximately 50,000 individual computers, distributed across the world, and uses bandwidth monitoring technology to prevent bandwidth cap overages[4].

References

  1. ^ http://venturebeat.com/2009/12/21/80legs-web-crawler-free/ 80legs sets its web crawler free
  2. ^ http://www.readwriteweb.com/archives/bulk_social_data_80legs.php Thoughts From the Man Who Would Sell The World, Nicely
  3. ^ http://gigaom.com/2009/09/22/80legs-is-where-setihome-meets-google/ 80legs is Where SETI@home Meets Google
  4. ^ http://gigaom.com/2009/05/14/80legs-cares-about-your-bandwidth-cap/ 80legs Cares About Your Bandwidth Cap

External Links

80legs