Videos

MarPanning - Darkstep

A little dubstep ditty that I wrote over the holidays using Ableton Live 8 Suite. Visualized using MarPanning, a program that displays a 3D panning spectrum in real time, part of the Marsyas toolkit.

Dancing RoboNova

RoboNova dancing to Blur. Each sequence of moves is synchronized to the musical beats, using MARSYAS' real-time beat-tracker - IBT (http://marsyas.info/)

Lego Robot dancing with rhythm (II)

Lego robot made by Joao Lobato dancing while listening to music. The rhythmic analysis is performed using Marsyas.

Marsyas with open frameworks and fiducial tracking

MarMixer is an openFrameworks application to mix several sound sources (microphone and sound files) using Marsyas. Fiducial markers from the Reactable project are used to control the volume and pitch of each sound; moving the crossfader fiducial closer to an audio source increases its volume, and rotating the fiducial for each audio source changes the pitch.

MarPanning

MarPanning is a 3D application that allows you to see the left/right panning for different frequency bins of an audio file. It's written in C++ using the Marsyas audio framework, Qt and OpenGL. The y-axis (up and down) shows the different frequency bins, with low frequencies at the bottom and high frequencies at the top. The x-axis (left to right) shows the Stereo Panning Index, as calculated by Marsyas for each frequency bin. The z-axis shows time. The dots are coloured green and are small if there is just low energy in that bin, and grow in size and get more yellow the more energy there is in that bin. The song that is playing is "In My Life" by the Beatles and produced by George Martin. The song starts with the guitar panned hard left, and you can see the different frequencies for the notes appearing from bottom to top. If you look closely, you can even see the melody about halfway up the screen. You can see and hear the vocals come in on the right later in the song. MarPanning is completely open source and under the GPL licence. You can play with it yourself by downloading and installing Marsyas.

MarSndPeek

MarSndPeek is a application written in Marsyas that shows you a 3D spectrogram for a song (or microphone input) in real time. It was inspired by sndpeek from the Princeton soundlab. It's written in C++ and uses the Marsyas audio framework, Qt and OpenGL. It's completely GPLed, so download Marsyas and try it yourself.

KeyBoard Controlled Assistive Music Browser

The goal of this project is to develop Assistive Music Browser Software that will enable users with severe disabilities to navigate through their own collections of music via a variety of input methods. We extract relevant features and analyze the audio data within a collection of music (of essentially unlimited size) and map the songs onto a 2-D space, called a self-organizing map, based on similarity. Continual audio feedback is provided to the user as they search their collection to aide in navigation and selection. http://www.canassist.ca

Somba

Samba rhythm creation using the Wii-Mote, Open Sound Control and Marsyas

Marsyas Genre Meter

A demo of the Marsyas Genre Meter, a program that shows the different genres a piece of music falls into. By George Tzanetakis.

Lego NXT Dancing to the Rhythm

Lara, a Lego-NXT-based robot, dancing to the rhythm of prodigy. It analyses the musical rhythm, based on onset detection, and embodies it with user-defined dance movements. The dance also varies with the color stepped on the dance floor (using a color sensor), while the robot (tries to) avoid the environment walls (with a sonar sensor). For more info consult http://paginas.fe.up.pt/~ee03123