MUMT 307

Outline

  • A talk by Julien
  • Music Information Retrieval
    • Introduction
    • History
    • Information retrieval
    • Classification and estimation
    • Sequence labeling
    • Evaluation
    • Corpora and databases
    • System issues
    • Socio-cultral issues
    • Intellectual property
    • Conferences & journals
MUMT 307

Introduction

Music information retrieval (MIR) is “a multidisciplinary research endeavor that strives to develop innovative content-based searching schemes, novel interfaces, and evolving networked delivery mechanisms in an effort to make the world’s vast store of music accessible to all” (Downie 2004).
  • Catergories of data
    • Image
    • Symbolic data
    • Audio
    • Metadata
MUMT 307

History

  • The term first use in the title of an academic paper: 1966
  • Computational musicology in the 1970: mostly symbolic music analysis
  • Research with audio data
    • Timbre identification: 1968
    • Pitch tracking: 1975
    • Key / Beat / Meter / Tempo extraction: 1985
    • Query by humming: 1993
    • First ISMIR conference: 2000
MUMT 307

Information Retrieval

MUMT 307

Information Retrieval: Symbolic data

  • Query by tapping
  • Melodic / harmonic similarity measures
  • Theme finding
MUMT 307

Information Retrieval: Audio

  • Cover-song identification
  • Query by humming
  • Fingerprinting
  • Similariy measures / recommendation
  • Playlist generation
MUMT 307

Information Retrieval: Metadata

  • Music recommendation
  • Database search and federation
  • Playlist generation (e.g., Pandora, Spotify, Rdio), etc.
MUMT 307

Classification and Estimation

  • Image data
  • Symbolic data
  • Audio
  • Metadata
MUMT 307

Classification and Estimation: Images

  • Scribe identification
  • Printer identification
MUMT 307

Classification and Estimation: Symbolic data

MUMT 307

Classification and Estimation: Audio

MUMT 307

Classification and Estimation: Metadata

MUMT 307

Sequence Labeling

  • Images
  • Symbolic data
  • Audio
MUMT 307

Sequence Labeling: Images

  • Optical music recognition
MUMT 307

Sequence Labeling: Symbolic data

  • Expressive timing
  • Voice separation
  • Automated harmonic analysis
  • Pitch spelling
MUMT 307

Sequence Labeling: Audio

MUMT 307

Evaluation

MUMT 307

Corpora and databases

  • Digital music libraries and archives
  • Public access to musical archives
  • Multi-agent systems, distributed search
  • Text and web mining
  • Web services an APIs
  • P2P / L2L search
MUMT 307

System issues

  • Performance
  • Compression
  • Scalability
  • Databases
  • Architecture
  • Distributed search / federation
  • Balance loading
  • Multi-agent systems / mashups
  • Mobile applications
MUMT 307

Socio-cultral issues

  • Business models and experience
  • Music and cultural heritage valorization
  • Non-Western music
  • Personalized user profiles
MUMT 307

Intellectual property

  • Copyright
  • Watermarking
  • Digital rights management
  • Expert witness
MUMT 307

Conferences and journals