ePrints.FRI - University of Ljubljana, Faculty of Computer and Information Science

A Mid-Level Representation for Melody-based Retrieval in Audio Collections

Matija Marolt (2008) A Mid-Level Representation for Melody-based Retrieval in Audio Collections. IEEE Transactions on Multimedia, 10 (8). pp. 1617-1625.

Download (342Kb)


    Searching audio collections using high-level musical descriptors is a difficult problem, due to the lack of reliable methods for extracting melody, harmony, rhythm, and other such descriptors from unstructured audio signals. In the paper, we present a novel approach to melody-based retrieval in audio collections. Our approach supports audio, as well as symbolic queries and ranks results according to melodic similarity to the query. We introduce a beat-synchronous melodic representation consisting of salient melodic lines, which are extracted from the analyzed audio signal. We propose the use of a two-dimensional shift-invariant transform to extract shift-invariant melodic fragments from the melodic representation and demonstrate how such fragments can be indexed and stored in a song database. An efficient search algorithm based on locality-sensitive hashing is used to perform retrieval according to similarity of melodic fragments. On the cover song detection task, good results are achieved for audio, as well as for symbolic queries, while fast retrieval performance makes the proposed system suitable for retrieval in large databases.

    Item Type: Article
    Keywords: audio collections, information retrieval, melody, music
    Related URLs:
    URLURL Type
    http://www.cobiss.si/scripts/cobiss?command=search&base=50070&select=(id=6908756)Alternative location
    Institution: University of Ljubljana
    Department: Faculty of Computer and Information Science
    Divisions: Faculty of Computer and Information Science > Laboratory of Computer Graphics and Multimedia
    Item ID: 913
    Date Deposited: 12 Nov 2009 14:43
    Last Modified: 05 Dec 2013 13:33
    URI: http://eprints.fri.uni-lj.si/id/eprint/913

    Actions (login required)

    View Item