Music Hacks
Ragawise |
Team: Sankalp Gulati, Swapnil Gupta, Kaustuv Kanti Ganguli and Ajay Srinivasamurthy
Affiliation: Music Technology Group, UPF, Barcelona Event: HAMR, ISMIR 2015, Málaga, Spain Ragawise is a web-based real-time melodic analysis and visualization system for Indian art music. It uses pitch class profiles, pitch transitions and melodic phrases for melodic characterization and rāga recognition. We process the input vocals in real-time to estimate pitch, and subsequently perform melody transcription. The likelihood of each rāga is updated in real-time based on the transcribed melody. In order to highlight the melodic events that are characteristic of a rāga, we perform a dynamic visualization of the evolution of the likelihood of all the rāgas for the sung melodic excerpt. The entire system is implemented using Javascript and D3.JS. This hack won the award for the best code.
|
Sawaal-Jawaab |
Team: Ajay Srinivasamurthy, Swapnil Gupta, Sankalp Gulati and Kaustuv Kanti Ganguli
Affiliation: Music Technology Group, UPF, Barcelona Event: HAMR, ISMIR 2015, Málaga, Spain During Hindustani music concerts, it is common to have a call-response improvisatory passages between musicians, called a sawaal-jawaab (literally, question-answer). It is also common in tabla solos to have a sawaal-jawaab between a musician reciting vocal syllables and a response by the musician playing the tabla. We explore such an improvisation in this hack - with the call being the vocal recitation of syllables. The response is an improvisation of the call built using timing, rhythmic and timbral features from the call, exploiting the onomatopeioc nature of the tabla bols. Such an improvisation is done within the framework of a specific taal, the rhythmic framework of Hindustani music. An example sawaal-jawaab in a concert between vocal melody and tabla is here: |
HodorizerDemo: Pre-processed examples
Code: Github (open-source) Description: Hackerleague Event link: MHD, Barcelona'14 Other: YouTube Channel What!!!, You don't know Hodor yet??? |
Team: Sankalp Gulati, Jordi Hidalgo, Varun Jewalikar and Hector Parra
Event: MusicHackDay, Barcelona, 2014 This hack aims at transforming a song as if it was sung using the word "Hodor" as the lyrics. Replaces (fully automatically) song lyrics with time-strecthed and transposed HODOR!
|
HindifyExamples: Hindify Soundcloud set
Code: Github (open-source) Description: Slides, Video (3 min) Event link: MHD, Barcelona'13 News/articles: Echonest blog, Pragrammable Web, DaveHodder |
Team: Sankalp Gulati and Varun Jewalikar
Event: MusicHackDay, Barcelona, 2013 Hindify automatically transforms an audio song to embed characteristics of Hindustani music such as slow tempo, a drone (Tanpura) in the background and tabla as the main percussion instrument. This hack uses Echonest API to estimate the key, beat & section locations within a song, and to time-stretch the song. Freesound API is used for fetching Tanpura & Tabla sounds for a particular key. This hack won the "best-hack" award from Echonest! Here is an example audio for one of the songs processed using Hindify: |
Take-1 |
Team: Sankalp Gulati, Varun Jewalikar and Aluiziob Oliveira
Event: MusicHackDay, Barcelona, 2012 Take-1 aimed to automatically generate a video for an audio song such that events in the video are synchronized to different musical events in the audio. The processing steps behind this hack were:
|
Music spaghetti |
Personal hack, a variant of the famous hack InfiniteJukeBox done originally by Paul Lamere using the EchoNest API. This variant uses Essentia, an open-source C++ library for audio analysis and music information retrieval.
Processing steps:
|