Query by humming
Encyclopedia
Query by humming is a music retrieval system that branches off the original classification systems of title, artist, composer, and genre. It normally applies to songs or other music with a distinct single theme or melody. The system involves taking a user-hummed melody
(input query
) and comparing it to an existing database
. The system then returns a ranked list of music closest to the input query.
One example of this would be a system involving a portable media player
with a built-in microphone
that allows for faster searching
through media
files.
The MPEG-7
standard includes provisions for QbH music searches.
Both are powered by the same backend and are capable of recognizing humming and singing as well as recorded tracks.
For the singing and humming search, the searchable database is based on Midomi.com's user contributions. Midomi has collected about one million tracks based on user contributions in multiple languages, making it the largest database of its kind by a large margin. The top four languages are: English, Japanese, Chinese and Spanish.
Musipedia
is an example of a QbH system that uses a variety of input methods such as humming, tapping the keyboard, keyboard search (a virtual piano keyboard), draw notes, and a contour search, using Parsons Code
to encode the music pieces.
Tunebot
is a music search engine that uses queries from humming, lyrics, and melody. People can contribute to the database and expand the variety of searchable songs. Tunebot also serves as the back-end for a game called Karaoke Callout
, in which players' performances are compared by the engine with songs in the database.
Melody
A melody , also tune, voice, or line, is a linear succession of musical tones which is perceived as a single entity...
(input query
Information retrieval
Information retrieval is the area of study concerned with searching for documents, for information within documents, and for metadata about documents, as well as that of searching structured storage, relational databases, and the World Wide Web...
) and comparing it to an existing database
Database
A database is an organized collection of data for one or more purposes, usually in digital form. The data are typically organized to model relevant aspects of reality , in a way that supports processes requiring this information...
. The system then returns a ranked list of music closest to the input query.
One example of this would be a system involving a portable media player
Portable media player
A portable media player or digital audio player, is a consumer electronics device that is capable of storing and playing digital media such as audio, images, video, documents, etc. the data is typically stored on a hard drive, microdrive, or flash memory. In contrast, analog portable audio...
with a built-in microphone
Microphone
A microphone is an acoustic-to-electric transducer or sensor that converts sound into an electrical signal. In 1877, Emile Berliner invented the first microphone used as a telephone voice transmitter...
that allows for faster searching
Search engine technology
Modern web search engines are complex software systems using the technology that has evolved over the years. There are several categories of search engine software: Web search engines , database or structured data search engines , and mixed search engines or enterprise search...
through media
Digital media
Digital media is a form of electronic media where data is stored in digital form. It can refer to the technical aspect of storage and transmission Digital media is a form of electronic media where data is stored in digital (as opposed to analog) form. It can refer to the technical aspect of...
files.
The MPEG-7
MPEG-7
MPEG-7 is a multimedia content description standard. It was standardized in ISO/IEC 15938 . This description will be associated with the content itself, to allow fast and efficient searching for material that is of interest to the user. MPEG-7 is formally called Multimedia Content Description...
standard includes provisions for QbH music searches.
Examples of QbH systems
SoundHound (and midomi) SoundHound and Midomi are the only commercially available query by humming services available online at Midomi.com or on the mobile app called SoundHound.Both are powered by the same backend and are capable of recognizing humming and singing as well as recorded tracks.
For the singing and humming search, the searchable database is based on Midomi.com's user contributions. Midomi has collected about one million tracks based on user contributions in multiple languages, making it the largest database of its kind by a large margin. The top four languages are: English, Japanese, Chinese and Spanish.
Musipedia
Musipedia
Musipedia is a search engine for identifying pieces of music. This can be done by whistling a theme, playing it on a virtual piano keyboard, tapping the rhythm on the computer keyboard, or entering the Parsons code...
is an example of a QbH system that uses a variety of input methods such as humming, tapping the keyboard, keyboard search (a virtual piano keyboard), draw notes, and a contour search, using Parsons Code
Parsons code
The Parsons code, formally named the Parsons Code for Melodic Contours, is a simple notation used to identify a piece of music through melodic motion—the motion of the pitch up and down. Denys Parsons developed this system for his 1975 book, The Directory of Tunes and Musical Themes...
to encode the music pieces.
Tunebot
Tunebot
Tunebot is a music search engine developed by the Interactive Audio Lab at Northwestern University. Users can search the database by humming or singing a melody into a microphone, playing the melody on a virtual keyboard, or by typing some of the lyrics...
is a music search engine that uses queries from humming, lyrics, and melody. People can contribute to the database and expand the variety of searchable songs. Tunebot also serves as the back-end for a game called Karaoke Callout
Karaoke Callout
Karaoke Callout is a karaoke dueling game developed by the Interactive Audio Lab at Northwestern University. It is an example of a game with a purpose. Its purpose is to help train the Tunebot database by providing the system with more query to target matches....
, in which players' performances are compared by the engine with songs in the database.
Online demos
- Midomi
- SoundHound (mobile app)
- QbH system from MusipediaMusipediaMusipedia is a search engine for identifying pieces of music. This can be done by whistling a theme, playing it on a virtual piano keyboard, tapping the rhythm on the computer keyboard, or entering the Parsons code...
- QbH research project at NYU
- Query by Humming at Sloud Inc, QbH applet (Active X)
- Musicline QbH based on technology from Fraunhofer Institut
- MaART at Sourceforge
- Tunebot at Northwestern University
General info and articles
- Comprehensive list of Music Information Retrieval systems (apparently last updated ca 2003)
- Query By Humming – Musical Information Retrieval in an Audio Database, paper by Asif Ghias, Jonathan Logan, David Chamberlin, Brian C. Smith; ACM MultimediaACM MultimediaACM Multimedia is the Association of Computing Machinery 's annual conference on multimedia, sponsored by the SIGMM special interest group....
1995 - A survey presentation of QBH by Eugene Weinstein, 2006
- The New Zealand Digital Library MELody inDEX, article by Rodger J. McNab, Lloyd A. Smith, David Bainbridge and Ian H. Witten; D-Lib MagazineD-Lib MagazineD-Lib Magazine is an on-line magazine dedicated to digital library research and development. Current and past issues are available free of charge. The publication is financially supported by contributions from the...
1997 - Name that Tune: A Pilot Study in Finding a Melody from a Sung Query, article by Bryan Pardo, Jonah Shifrin, and William Birmingham, Journal of the American Society for Information Science and Technology, vol. 55 (4), pp. 283-300, 2004