ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

Piano Crossing - Generating music using computer vision

Matevž Lipanje (2010) Piano Crossing - Generating music using computer vision. EngD thesis.

[img] PDF
Download (3208Kb)


    Piano Crossing is an interactive art installation which transforms the zebra crossing into a working piano keyboard where pedestrians generate music by walking across it. Installation consists of the zeboard - zebra crossing turned keyboard - by adding black stripes to the existing white ones, serving as keys, a digital camera overlooking the zeboard and of a laptop computer with speakers. The computer runs a specially designed software, which recognizes pedestrian's contacts with the keys by using OpenCV's computer vision methods, and by that generates a MIDI sequence, which furthermore turns into music. The application consists of two main processes. 'Generate Keyboard' is about creating abstract presentation of MIDI keyboard from an input frame. The image is segmentated to individual regions belonging to the keys. Each key includes a contour of the region, a MIDI note number and a key status. The abstract keyboard presentation is then used in the 'Track and Play' process, which brings the actual execution. For the pedestrian positioning two different background substraction techniques can be used; the simple technique or the advanced codebook model technique. The installation software was tested on two different models of the Piano Crossing; on an actual zebra crossing outdoor and on the reduced-in-size model indoor.

    Item Type: Thesis (EngD thesis)
    Keywords: computer vision, art installation, music, piano
    Number of Pages: 46
    Language of Content: Slovenian
    Mentor / Comentors:
    Name and SurnameIDFunction
    prof. dr. Franc Solina71Mentor
    Link to COBISS: http://www.cobiss.si/scripts/cobiss?command=search&base=50070&select=(ID=7532372)
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Item ID: 998
    Date Deposited: 18 Jan 2010 13:19
    Last Modified: 13 Aug 2011 00:36
    URI: http://eprints.fri.uni-lj.si/id/eprint/998

    Actions (login required)

    View Item