Music visualization
Encyclopedia
Computer-generated imagery
Computer-generated imagery is the application of the field of computer graphics or, more specifically, 3D computer graphics to special effects in art, video games, films, television programs, commercials, simulators and simulation generally, and printed media...
based on a piece of music. The imagery is usually generated and rendered in real time and synchronized with the music as it is played.
Visualization techniques range from simple ones (e.g., a simulation of an oscilloscope
Oscilloscope
An oscilloscope is a type of electronic test instrument that allows observation of constantly varying signal voltages, usually as a two-dimensional graph of one or more electrical potential differences using the vertical or 'Y' axis, plotted as a function of time,...
display) to elaborate ones, which often include a plurality of composited
Compositing
Compositing is the combining of visual elements from separate sources into single images, often to create the illusion that all those elements are parts of the same scene. Live-action shooting for compositing is variously called "chroma key", "blue screen", "green screen" and other names. Today,...
effects. The changes in the music's loudness
Loudness
Loudness is the quality of a sound that is primarily a psychological correlate of physical strength . More formally, it is defined as "that attribute of auditory sensation in terms of which sounds can be ordered on a scale extending from quiet to loud."Loudness, a subjective measure, is often...
and frequency spectrum
Frequency spectrum
The frequency spectrum of a time-domain signal is a representation of that signal in the frequency domain. The frequency spectrum can be generated via a Fourier transform of the signal, and the resulting values are usually presented as amplitude and phase, both plotted versus frequency.Any signal...
are among the properties used as input to the visualization.
History
Atari Video Music
The Atari Video Music was introduced by Atari Inc. in 1976, and designed by the initiator of the home version of Pong, Robert Brown. The idea was to create a visual exploration that could be implemented into a Hi-Fi stereo system...
introduced by Atari Inc.
Atari, Inc
Atari, Inc. was an American video game and home computer company founded in 1972 by Nolan Bushnell and Ted Dabney. Primarily responsible for the formation of the video arcade and modern video game industries, the company was closed and its assets split in 1984 as a direct result of the North...
in 1976, and designed by the initiator of the home version of Pong
Pong
Pong is one of the earliest arcade video games, and is a tennis sports game featuring simple two-dimensional graphics. While other arcade video games such as Computer Space came before it, Pong was one of the first video games to reach mainstream popularity...
, Robert Brown. The idea was to create a visual exploration that could be implemented into a Hi-Fi stereo system. It is described in .
Music and audio players were available on early home computers, Sound to Light Generator (1985, Infinite Software) used the ZX Spectrum's cassette player for example. The 1984 movie Electric Dreams prominently made use of one, although as a pre-generated effect, rather than calculated in real-time. One of the first modern music visualization programs was the open-source, multi-platform Cthugha
Cthugha (software)
Cthugha is a music visualization computer program. It was written in the mid-90's by Kevin "Zaph" Burfitt, originally for the PC, and was later ported to other platforms. It was freely distributed.-History:...
(1994). Subsequently, computer music visualisation became widespread in the mid to late 1990s as applications such as Winamp
Winamp
Winamp is a media player for Windows-based PCs and Android devices, written by Nullsoft, now a subsidiary of AOL. It is proprietary freeware/shareware, multi-format, extensible with plug-ins and skins, and is noted for its graphical sound visualization, playlist, and media library features.Winamp...
(1997), Audion
Audion (software)
Audion is an audio player by Panic. It was originally a commercial program, but with the dominance of Apple's iTunes, development was halted and it was released as freeware.-Design:...
(1999), and SoundJam (2000). By 1999, there were several dozen freeware non-trivial music visualizers in distribution.
In particular, MilkDrop
MilkDrop
MilkDrop is an open source, hardware-accelerated music visualization plugin for Winamp, which was originally developed by Ryan Geiss. It uses DirectX and intelligent beat detection to render iterated images which blend seamlessly...
by Ryan Geiss, G-Force by Andy O'Meara
Andy O'Meara
Andy O'Meara is a creator of artistic music visualization software, and founded SoundSpectrum in 2000. O'Meara attended Cornell University, graduating in computer science in 1999 on a Navy Reserve Officers' Training Corps scholarship. He completed a five-year commitment as a naval submarine...
, and Advanced Visualization Studio
Advanced Visualization Studio
Advanced Visualization Studio , is a music visualization plugin for Winamp. It was designed by Winamp's creator, Justin Frankel. AVS has a customizable design which allows users to create their own visualization effects, or "presets". AVS was made open source software in May 2005, released under a...
(AVS) by Nullsoft
Nullsoft
Nullsoft, Inc. is a software house founded in Sedona, Arizona in 1997 by Justin Frankel. Its most known products include the Winamp media player and the SHOUTcast MP3 streaming media server. In recent years, their open source installer system, NSIS, has also risen in popularity as a widely used...
became popular music visualizations. AVS is part of Winamp
Winamp
Winamp is a media player for Windows-based PCs and Android devices, written by Nullsoft, now a subsidiary of AOL. It is proprietary freeware/shareware, multi-format, extensible with plug-ins and skins, and is noted for its graphical sound visualization, playlist, and media library features.Winamp...
and has been recently open-sourced, and G-Force was licensed for use in iTunes
ITunes
iTunes is a media player computer program, used for playing, downloading, and organizing digital music and video files on desktop computers. It can also manage contents on iPod, iPhone, iPod Touch and iPad....
and Windows Media Center
Windows Media Center
Windows Media Center is a digital video recorder and media player developed by Microsoft. It is an application that allows users to view and record live television, as well as organize and play music and videos...
and is presently the flagship product for Andy O'Meara's software startup company, SoundSpectrum
SoundSpectrum
SoundSpectrum, previously known as WhiteCap Technologies is a software company founded in 2000 that develops music visualization software...
. The real distinction between music visualization programs such as Geiss' MilkDrop
MilkDrop
MilkDrop is an open source, hardware-accelerated music visualization plugin for Winamp, which was originally developed by Ryan Geiss. It uses DirectX and intelligent beat detection to render iterated images which blend seamlessly...
and other forms of music visualization such as music videos or a laser lighting display
Laser lighting display
A laser lighting display or laser light show involves the use of laser light to entertain an audience. A laser light show may consist only of projected laser beams set to music, or may accompany another form of entertainment, typically a dance concert or other musical performance.Laser light is...
is the visualization programs' ability to create different visualizations for each song every time the program is run.
List of electronic music visualizers
- Atari Video MusicAtari Video MusicThe Atari Video Music was introduced by Atari Inc. in 1976, and designed by the initiator of the home version of Pong, Robert Brown. The idea was to create a visual exploration that could be implemented into a Hi-Fi stereo system...
, designed by the initiator of the home version of PongPongPong is one of the earliest arcade video games, and is a tennis sports game featuring simple two-dimensional graphics. While other arcade video games such as Computer Space came before it, Pong was one of the first video games to reach mainstream popularity...
, Robert Brown, and introduced by Atari Inc.Atari, IncAtari, Inc. was an American video game and home computer company founded in 1972 by Nolan Bushnell and Ted Dabney. Primarily responsible for the formation of the video arcade and modern video game industries, the company was closed and its assets split in 1984 as a direct result of the North...
in 1976. - Pixelmusic 3000, open source music visualizer on a microcontroller, made by Uncommon Projects in 2008.
List of music visualization software
- CthughaCthugha (software)Cthugha is a music visualization computer program. It was written in the mid-90's by Kevin "Zaph" Burfitt, originally for the PC, and was later ported to other platforms. It was freely distributed.-History:...
(Kevin "Zaph" Burfitt, 1993) - Rabbit Hole (2001 version for Sonique Sonique (media player)Sonique is an audio player application released as freeware for Microsoft Windows, capable of handling MP3, Ogg Vorbis, Microsoft Windows Media, audio CDs, and more....
, 2011 port for the App Store (iOS)) - Advanced Visualization StudioAdvanced Visualization StudioAdvanced Visualization Studio , is a music visualization plugin for Winamp. It was designed by Winamp's creator, Justin Frankel. AVS has a customizable design which allows users to create their own visualization effects, or "presets". AVS was made open source software in May 2005, released under a...
(Justin FrankelJustin FrankelJustin Frankel is an American computer programmer best known for his work on the Winamp media player application and for inventing the gnutella peer-to-peer network...
) - G-ForceSoundSpectrumSoundSpectrum, previously known as WhiteCap Technologies is a software company founded in 2000 that develops music visualization software...
(2000, Andy O'MearaAndy O'MearaAndy O'Meara is a creator of artistic music visualization software, and founded SoundSpectrum in 2000. O'Meara attended Cornell University, graduating in computer science in 1999 on a Navy Reserve Officers' Training Corps scholarship. He completed a five-year commitment as a naval submarine...
, SoundSpectrumSoundSpectrumSoundSpectrum, previously known as WhiteCap Technologies is a software company founded in 2000 that develops music visualization software...
) - MilkDropMilkDropMilkDrop is an open source, hardware-accelerated music visualization plugin for Winamp, which was originally developed by Ryan Geiss. It uses DirectX and intelligent beat detection to render iterated images which blend seamlessly...
(2001, Ryan Geiss), an OpenGLOpenGLOpenGL is a standard specification defining a cross-language, cross-platform API for writing applications that produce 2D and 3D computer graphics. The interface consists of over 250 different function calls which can be used to draw complex three-dimensional scenes from simple primitives. OpenGL...
implementation, projectM, and a WebGLWebGLWebGL is a software library that extends the capability of the JavaScript programming language to allow it to generate interactive 3D graphics within any compatible web browser...
implementation, milkshake - Music Animation Machine (MAM, 1985) visualizes MIDI scores, rather than waveforms.
- MIDIjamMIDIjamMIDIJam is a program created by Scott Haag that visualizes MIDI files in 3D using musical instruments in real time. The list of instruments are available at Scott Haag's website...
, which also visualizes MIDI files, but with three-dimensional instruments rather than two-dimensional graphics. - Virtual Light MachineVirtual Light MachineThe Virtual Light Machine is a light synthesizer developed by Jeff Minter in 1990. It was installed into a number of electronics, including the Atari Jaguar CD and Nuon DVD players....
(Jeff MinterJeff MinterJeff 'Yak' Minter is a British computer/video game designer and programmer. He is the founder of software house Llamasoft and his recent works include Neon , a non-game music visualization program that has been built into the Xbox 360 console, and the video games Space Giraffe , and Space Invaders...
, 1990) - NeonNeon (light synthesizer)Neon is a light synthesizer developed by Jeff Minter and Ivan Zorzin . It was based on an enhanced version of the graphics engine originally to be included in Unity , which became an independent project after Unity was cancelled in 2004.A version of Neon is used as the default visualiser for the...
(Jeff MinterJeff MinterJeff 'Yak' Minter is a British computer/video game designer and programmer. He is the founder of software house Llamasoft and his recent works include Neon , a non-game music visualization program that has been built into the Xbox 360 console, and the video games Space Giraffe , and Space Invaders...
and Ivan Zorzin, 2004) - SONOVISTA™ BiT BOPPER (1993, O'Wonder)
- Whip! (1999, Escape)
- TronMe (2006, 3D Solar)
- Visual Music Tone Painter (1992-2004, Stephen NachmanovitchStephen NachmanovitchStephen Nachmanovitch is a musician, author, computer artist, and educator. He is an improvisational violinist, and writes and teaches about improvisation, creativity, and systems approaches in many fields of activity.-Biography:...
) - VsxuVsxuVSXu is an OpenGL-based , modular programming environment with its main purpose to visualize music and create 3D effects in real-time. Available for Windows and GNU/Linux. It is currently released as free software under terms of the GNU General Public License v2 and maintained by Vovoid Software...
(2003, Vovoid) - Morphyre (2009, Pur3 Ltd)
- Tripex (2002, Ben Marsh)
An early "light synthesizer", Psychedelia
Psychedelia (light synthesizer)
Psychedelia is an early light synthesizer developed by Jeff Minter and published by Llamasoft in 1984. It was converted to the MSX and ZX Spectrum by Simon Freeman.-Usage:...
(1984, Jeff Minter), did not use audio input but was designed to create visualizations in accompaniment to music.
List of media players supporting visualization
- Foobar2000Foobar2000foobar2000 is a freeware audio player for Windows developed by Peter Pawlowski, a former freelance contractor for Nullsoft. It is known for its highly modular design and extensive SDK which allows third-party developers to do such things as completely replace the interface...
(Platform: Windows) - MediaPortalMediaPortalMediaPortal is an open-source media center software project, often considered an alternative to Windows Media Center. It provides a 10-foot user interface for performing typical PVR/TiVo functionality, including playing, pausing, and recording live TV; playing DVDs, videos, and music; viewing...
(OpenSource, Team MediaPortal) (Platform: Windows) - iTunesITunesiTunes is a media player computer program, used for playing, downloading, and organizing digital music and video files on desktop computers. It can also manage contents on iPod, iPhone, iPod Touch and iPad....
(2001, Apple) (Platforms: Mac OS X, Windows) - WinampWinampWinamp is a media player for Windows-based PCs and Android devices, written by Nullsoft, now a subsidiary of AOL. It is proprietary freeware/shareware, multi-format, extensible with plug-ins and skins, and is noted for its graphical sound visualization, playlist, and media library features.Winamp...
(Nullsoft/AOL) (Platforms: Windows) - Windows Media PlayerWindows Media PlayerWindows Media Player is a media player and media library application developed by Microsoft that is used for playing audio, video and viewing images on personal computers running the Microsoft Windows operating system, as well as on Pocket PC and Windows Mobile-based devices...
(Microsoft) (Platforms: Windows) - MediaMonkeyMediaMonkeyMediaMonkey is a proprietary digital media player and media library application developed by Ventis Media Inc., for organizing and playing audio on Microsoft Windows operating systems. By using plugins, it can be extended to handle video and other media formats as well.MediaMonkey is available in a...
(Ventis Media Inc.) (Platform: Windows) - MusicBeeMusicBeeMusicBee is a free digital media player and media library application for organizing and playing audio on Microsoft Windows operating systems using the BASS Audio Library.-Features:...
(Steven Mayall) (Platforms: Windows) - K-Multimedia PlayerK-Multimedia PlayerK-Multimedia Player is a media player software for Microsoft Windows which can play a large number of formats including VCD, DVD, AVI, MKV, Ogg, OGM, 3GP, MPEG-1/2/4, WMV, RealMedia, FLV and QuickTime...
(Pandora.TV) (Platform: Windows) - Amarok (Open Source, KDE) (Platform: Linux)
- TotemTotem (media player)Totem is a media player for the GNOME computer desktop environment which runs on GNU/Linux, Solaris, BSD and other Unix and Unix-like systems. It is officially included in GNOME starting from version 2.10 , but de facto it was already included in most GNOME environments...
(Open Source, Gnome) (Platform: Linux) - Audacious Media PlayerAudacious Media PlayerAudacious is a free software audio player with a focus on low resource usage, high audio quality, and support for a wide range of audio formats. It is designed primarily for use on POSIX-compatible systems such as Linux, with limited support for Microsoft Windows...
(Audacious Team) (Platforms: POSIX) - VLC media playerVLC media playerVLC media player is a free and open source media player and multimedia framework written by the VideoLAN project.VLC is a portable multimedia player, encoder, and streamer supporting many audio and video codecs and file formats as well as DVDs, VCDs, and various streaming protocols. It is able to...
(VideoLANVideoLANVideoLAN is a project that develops software for playing video and other media formats across a local area network . It originally developed two programs for media streaming, VideoLAN Client and VideoLAN Server , but most of the features of VLS have been incorporated into VLC, with the result...
Project) (Platforms: Cross-platform)
See also
- Clavier à lumièresClavier à lumièresThe clavier à lumières , or tastiéra per luce, as it appears in the score, was a musical instrument invented by Alexander Scriabin for use in his work Prometheus: Poem of Fire. However, only one version of this instrument was constructed, for the performance of Prometheus: Poem of Fire in New York...
- Liquid light show
- Video artVideo artVideo art is a type of art which relies on moving pictures and comprises video and/or audio data. . Video art came into existence during the 1960s and 1970s, is still widely practiced and has given rise to the widespread use of video installations...
- CymaticsCymaticsCymatics is the study of visible sound and vibration, a subset of modal phenomena. Typically the surface of a plate, diaphragm, or membrane is vibrated, and regions of maximum and minimum displacement are made visible in a thin coating of particles, paste, or liquid...
- LibvisualLibvisualLibvisual is an abstraction library that comes between applications and audio visualisation plugins.Often when it comes to audio visualization plugins or programs that create visuals, they depend on a player or something else; basically, there is no general framework that enabled application...
External links
- Laser Harp midi controller for ILDA compliant laser projectors
- Music Visualization: Beautiful Tools to 'See' Sound inactive @25/11/11
- Visual Music Archive by Prof. Dr. Heike Sperling