Query by humming
Query by humming (QbH) is a music retrieval system that branches off the original classification systems of title, artist, composer, and genre. It normally applies to songs or other music with a distinct single theme or melody. The system involves taking a user-hummed melody (input query) and comparing it to an existing database. The system then returns a ranked list of music closest to the input query.
One example of this would be a system involving a portable media player with a built-in microphone that allows for faster searching through media files.
The MPEG-7 standard includes provisions for QbH music searches.
Examples of QbH systems
SoundHound and Midomi are the only commercially available query by humming services available online at Midomi.com or on the mobile app called SoundHound. Both are powered by the same backend and are capable of recognizing humming and singing as well as recorded tracks. For the singing and humming search, the searchable database is based on Midomi.com's user contributions. Midomi has collected about one million tracks based on user contributions in multiple languages, making it the largest database of its kind by a large margin. The top four languages are: English, Japanese, Chinese and Spanish.
"Musipedia" is an example of a QbH system that uses a variety of input methods such as humming, tapping the keyboard, keyboard search (a virtual piano keyboard), draw notes, and a contour search, using Parsons Code to encode the music pieces.
Tunebot is a music search engine that uses queries from humming, lyrics, and melody. People can contribute to the database and expand the variety of searchable songs. Tunebot also serves as the back-end for a game called Karaoke Callout, in which players' performances are compared by the engine with songs in the database.
External links
Online demos
- Midomi
- SoundHound (mobile app)
- QbH system from Musipedia
- QbH research project at NYU
- Query by Humming at Sloud Inc, QbH applet (Active X)
- Musicline QbH based on technology from Fraunhofer Institut (German)
- MaART at Sourceforge
- Tunebot at Northwestern University
General info and articles
- Comprehensive list of Music Information Retrieval systems (apparently last updated ca 2003) at the Wayback Machine (archived December 21, 2008)
- Query By Humming – Musical Information Retrieval in an Audio Database, paper by Asif Ghias, Jonathan Logan, David Chamberlin, Brian C. Smith; ACM Multimedia 1995
- A survey presentation of QBH by Eugene Weinstein, 2006
- The New Zealand Digital Library MELody inDEX, article by Rodger J. McNab, Lloyd A. Smith, David Bainbridge and Ian H. Witten; D-Lib Magazine 1997
- Name that Tune: A Pilot Study in Finding a Melody from a Sung Query, article by Bryan Pardo, Jonah Shifrin, and William Birmingham, Journal of the American Society for Information Science and Technology, vol. 55 (4), pp. 283-300, 2004