Presto (SQL query engine)

Presto is an open-source software project to develop a database query engine using the standard Structured Query Language (SQL).

Description

Facebook commenced development efforts on Presto in 2012, and announced its release as open source for Apache Hadoop in 2013.[1][2] In 2014, Netflix disclosed they used Presto on 10 petabytes of data stored in the Amazon Simple Storage Service (S3).[3] Airbnb released the source to web interface software called Airpal for Presto in March, 2015.[4][5] In June 2015, data-warehousing company Teradata promoted its commercial support, using the Apache License for the software.[6]

Presto Architecture
Presto's query federation capabilities

Presto’s architecture is very similar to a classic database management system using cluster computing. It can be visualized as one coordinator node working in sync with multiple worker nodes. Clients submit SQL statements that get parsed and planned following which parallel tasks are scheduled to workers. Workers jointly process rows from the data sources and produce results that are returned to the client. This compares to the original Apache Hive execution model, which used the Hadoop MapReduce mechanism on each query. It is written in the Java programming language.[1]

A single Presto query can combine data from multiple sources. Presto offers connectors to data sources including files in a Hadoop distributed file system, MySQL, Apache Kafka, Apache Cassandra, PostgreSQL and Redis. Several similar tools are Hadoop distribution-specific, such as Cloudera Impala. Presto uses distributions like Hortonworks, Cloudera or MapR.

References

  1. 1 2 Joab Jackson (November 6, 2013). "Facebook goes open source with query engine for big data". Computer World. Retrieved April 26, 2017.
  2. ↑ Jordan Novet (June 6, 2013). "Facebook unveils Presto engine for querying 250 PB data warehouse". Giga Om. Retrieved April 26, 2017.
  3. ↑ Eva Tse, Zhenxiao Luo, Nezih Yigitbasi (October 7, 2014). "Using Presto in our Big Data Platform on AWS". Netflix technical blog. Retrieved April 26, 2017.
  4. ↑ Doug Henschen (March 5, 2015). "Airbnb Boosts Presto SQL Query Engine For Hadoop". Information Week. Retrieved April 26, 2017.
  5. ↑ James Mayfield (March 4, 2015). "Airpal: a Web UI for PrestoDB". Airbnb blog post. Archived from the original on March 6, 2015. Retrieved April 26, 2017.
  6. ↑ "Teradata Launches First Enterprise Support for Presto". Press release. June 8, 2015. Retrieved April 26, 2017.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.