Current Research

This space outlines research projects I am currently involved in. My industry research is not listed here, as it is constrained by non-disclosure agreements.

SIMSSA: Single Interface for Music Score Searching and Analysis

SIMSSA (Single Interface for Music Score Searching and Analysis) is a broad, long-term international research project involving a large number of institutions and millions of dollars of grant funding. The primary goal of the project is to teach computers to recognize and understand the symbols in musical manuscripts archived at libraries and museums around the world. The resultant data will ultimately be assembled on a single web site, making it possible to easily search and analyze the online scores. SIMSSA is therefore creating an architecture for processing music documents into symbolic representations that can be searched, studied, analyzed and performed anywhere in the world. This involves two main research axes:

My own primary role is in the Analysis Axis, where I focus on applying music information retrieval (MIR) techniques to the symbolic content in order to arrive at meaningful statistics that can be used to characterize, classify, organize and search music. In particular, this involves expanding, adapting and applying the jSymbolic and ACE components of the jMIR research software suite in order to take advantage of and integrate their feature extraction and machine learning functionality into the SIMSSA framework.

I am also involved in designing and supervising the initial implementation of the SIMSSA DB, a repository and discovery tool for symbolic music files that puts a particular emphasis on:

My work on the SIMSSA project is done in loose affiliation with the MIRAI project, described below.

MIRAI: Music Information, Research and Infrastructure

MIRAI (Music Information, Research and Infrastructure) is another large-scale, multi-institutional project, and is loosely linked to the SIMSSA project described above. The main goal of MIRAI is to use computational tools to study and answer questions about how humans interact with music as information. This can perhaps be described as “data-intensive musicology,” a comprehensive research program for music information retrieval and computer-aided musicology addressing large amounts of music information. This work includes musical information in a wide variety of digital modes, including scores, audio, text and metadata.

My own role in the MIRAI project to date has focused on carrying out musicological research using the jMIR tools, particularly jSymbolic, in collaboration with expert musicologists. So far, this has primarily involved applying feature extraction, machine learning and statistical analysis techniques to Renaissance music, for the purpose of quantitatively delineating elements of music style associated with composers, genres, regions and more. The Publications section of this web site provides links to the products of this work to date.

Future steps of my research as part of the MIRAI project will turn to multimodal analysis of music, including audio, musical texts and metadata, in addition to the digitized symbolic scores I am already working with. This will involve the integrated use of the various jMIR tools, described below, and will build on my earlier work as part of the Networked Environment for Music Analysis (NEMA) project and during my doctoral and post-doctoral studies.

jMIR: General-Purpose Standardized Software for Music Information Retrieval Research

jMIR is an open-source software suite for use in music information retrieval (MIR) research. It can be used to study music in both audio and symbolic formats, as well as to mine cultural information from the web and manage music collections. jMIR also includes software for extracting features, applying machine learning algorithms and analyzing metadata.

The primary emphasis of jMIR is on providing software for general research in automatic music classification and similarity analysis. The main goals of the project are as follows:

More information on jMIR is available on the dedicated jMIR homepage, and there are also many publications on the jMIR components available in the publications section of this web site. The bullet points below outline each of the specific components of jMIR:

Feature Extraction

Data Mining and Machine Learning

Education and Audio Production

Data and Metadata


MML16: Mapping the Musical Landscape of the Sixteenth Century

MML16 (Mapping the Musical Landscape of the Sixteenth Century) is a new major international project that aims to build digital inventories of all musical sources of polyphonic music printed or copied during the sixteenth century, with information on dates, provenance and type of source. This is being carried out in collaboration with RISM.

-top of page-