Elasticsearch

Elasticsearch
Developer(s) Shay Banon
Stable release 1.5.1 / April 9, 2015
Development status Active
Written in Java
Operating system Cross-platform
Type Search and index
License Apache License 2.0
Website www.elastic.co/products/elasticsearch
Elasticsearch BV
Industry Software Development
Headquarters Amsterdam
Services Elasticsearch commercial solutions
Website www.elastic.co
Shay Banon talking about Elasticsearch at Berlin Buzzwords 2010

Elasticsearch is a search server based on Lucene. It provides a distributed, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. Elasticsearch is developed in Java and is released as open source under the terms of the Apache License. Elasticsearch is the second most popular enterprise search engine.[1]

History

Shay Banon created Compass in 2004.[2] While thinking about the third version of Compass he realized that it would be necessary to rewrite big parts of Compass to "create a scalable search solution".[2] So he created "a solution built from the ground up to be distributed" and used a common interface, JSON over HTTP, suitable for programming languages other than Java as well.[2] Shay Banon released the first version of Elasticsearch in February 2010.[3]

Elasticsearch BV was founded in 2012 to provide commercial solutions around Elasticsearch and related software.[4] In June 2014, the company announced raising $70 million in a Series C funding round, just 18 months after forming the company. The round was led by New Enterprise Associates (NEA). Additional funders include Benchmark Capital and Index Ventures. This round brings total funding to $104M.[5]

Overview

Elasticsearch can be used to search all kinds of documents. It provides scalable search, has near real-time search, and supports multitenancy.[6] "Elasticsearch is distributed, which means that indices can be divided into shards and each shard can have zero or more replicas. Each node hosts one or more shards, and acts as a coordinator to delegate operations to the correct shard(s). Rebalancing and routing are done automatically [...]".[6]

It uses Lucene and tries to make all features of it available through the JSON and Java API. It supports facetting and percolating,[7] which can be useful for notifying if new documents match for registered queries.

Another feature is called "gateway" and handles the long term persistence of the index;[8] for example, an index can be recovered from the gateway in a case of a server crash. Elasticsearch supports real-time GET requests, which makes it suitable as a NoSQL solution,[9] but it lacks distributed transactions.[10]

Users

Notable users of Elasticsearch[11] include Wikimedia,[12] StumbleUpon,[13] Mozilla,[14][15] Quora,[16] Foursquare,[17] Etsy,[18] SoundCloud,[19] GitHub,[20] FDA,[21] CERN,[22] Stack Exchange,[23] Center for Open Science,[24] Reverb[25], Netflix.[26], Sophos and the Slurm Workload Manager.

See also

Videos

References

  1. ↑ "DB-Engines Ranking - popularity ranking of search engines". db-engines.com. Retrieved 25 March 2015.
  2. ↑ 2.0 2.1 2.2 Banon, Shay. "The Future of Compass & ElasticSearch". Archived from the original on 2013-08-27.
  3. ↑ Banon, Shay (2010-02-08). "You Know, for Search". Archived from the original on 2013-01-16.
  4. ↑ "Immediate Insight from Data Matters". elastic.co. Retrieved 25 March 2015.
  5. ↑ "ElasticSearch Scores $70M In Series C To Fund Growth Spurt". TechCrunch. AOL. Retrieved 25 March 2015.
  6. ↑ 6.0 6.1 "Official Website". Elasticsearch.org. Retrieved 2014-02-04.
  7. ↑ "percolate at elasticsearch.org reference". Elasticsearch.org. Retrieved 2014-02-04.
  8. ↑ "elasticsearch Guide: Gateway". elasticsearch. Retrieved April 19, 2013.
  9. ↑ "Elasticsearch as database". Karussell.wordpress.com. Retrieved 2014-02-04.
  10. ↑ "No transaction support". Elasticsearch-users.115913.n3.nabble.com. 2010-07-08. Retrieved 2014-02-04.
  11. ↑ "Elasticsearch.org Case Studies". Elasticsearch.org. Retrieved 2014-10-03.
  12. ↑ Horohoe, Chad (2014-01-06). "Wikimedia moving to Elasticsearch". Wikimedia blog. Retrieved 2014-02-21.
  13. ↑ "StumbleUpon | Developer Blog". StumbleUpon.com. Retrieved 2014-02-21.
  14. ↑ "Blog of Data". mozilla.org. Retrieved 25 March 2015.
  15. ↑ "ElasticSearch helps Mozilla Metrics team". Pedroalves-bi.blogspot.com. Retrieved 2014-02-04.
  16. ↑ "Full Text Search on Quora". Quora.com. Retrieved 2014-02-04.
  17. ↑ "foursquare now uses Elastic Search (and on a related note: Slashem also works with Elastic Search)! | Foursquare Engineering Blog". Engineering.foursquare.com. Retrieved 2014-02-21.
  18. ↑ "Oculus: The metric correlation component of Etsy's Kale system". Github.com. Retrieved 2014-02-04.
  19. ↑ Petar Djekic. "Architecture behind our new Search and Explore experience". Backstage.soundcloud.com. Retrieved 2014-02-04.
  20. ↑ "A Whole New Code Search". Github.com. 2013-01-23. Retrieved 2014-02-21.
  21. ↑ "openFDA - About the API". FDA.gov.
  22. ↑ "Needle in a haystack - Using Elasticsearch to run the Large Hadron Collider of CERN". medium.com.
  23. ↑ Craver, Nick (22 November 2013). "What it takes to run Stack Overflow". Retrieved 2 October 2014.
  24. ↑ "Center for Open Science".
  25. ↑ Pritzker, Yan "How we switched elasticsearch clusters without anybody noticing", Reverb Blog, Chicago, 8 October 2014
  26. ↑ "The Netflix Tech Blog: Introducing Raigad - An Elasticsearch Sidecar".
  27. ↑ "Missing intro to elasticsearch".
  28. ↑ "PyCon 2013 - Elasticsearch (Part 1): Indexing and Querying". Youtube.com. Retrieved 2014-02-04.
  29. ↑ "Video, InfoQ presentation". Infoq.com. 2011-10-18. Retrieved 2014-02-04.
  30. ↑ "Shay Banon Elasticsearch - A Distributed Search Engine On Vimeo". Vimeo.com. 2011-07-21. Retrieved 2014-02-21.
  31. ↑
  32. ↑
  33. ↑
  34. ↑ from newthinking PRO 1 year ago Not Yet Rated (2012-06-26). "Berlin Buzzwords 2012". Vimeo.com. Retrieved 2014-02-04.
  35. ↑ Zmievski, Andrei (25 Feb 2011). "99 Problems, But The Search Ain't One (PHP UK 2011)". elasticsearch. Retrieved July 26, 2014.
  36. ↑

External links