EPSRC logo

Details of Grant 

EPSRC Reference: EP/L027119/2
Title: Musical Audio Repurposing using Source Separation
Principal Investigator: Plumbley, Professor M
Other Investigators:
Dixon, Professor S Hummersone, Dr C Mason, Dr R
Dewhirst, Dr MC Bryan-Kinns, Professor NJ Jackson, Dr P
Kudumakis, Dr P Sandler, Professor M Wang, Professor W
Reiss, Professor JD Coleman, Dr P
Researcher Co-Investigators:
Mr C Cannam Dr S Ewert
Project Partners:
BBC Cork Institute of Technology Erlangen-Nuremberg, University of
INRIA Northwestern University Telecom ParisTech
University of Surrey
Department: Vision Speech and Signal Proc CVSSP
Organisation: University of Surrey
Scheme: Standard Research
Starts: 01 April 2015 Ends: 31 October 2018 Value (£): 856,793
EPSRC Research Topic Classifications:
Music & Acoustic Technology
EPSRC Industrial Sector Classifications:
Creative Industries
Related Grants:
Panel History:  
Summary on Grant Application Form
Delivery of audio has become increasingly complex: originally in single channel (mono) or 2-channel stereo format, now surround sound in "5.1" format (5 main speakers plus one low frequency effects channel) is available in many home cinema systems, and many other multichannel audio formats are available (e.g. 6.1, 7.1, 10.2 and 22.2). In addition, new interactive apps allow users to remix musical audio, changing instrument volumes, and music games allow players to control individual instruments. Content creators therefore have to develop new ways to create and distribute their audio content to allow their content to be played back on these multichannel systems, or remixed by users to suit their own tastes.

However, much audio content is still in legacy formats, mainly 2-channel stereo. We therefore need ways to "repurpose" this legacy audio content, converting these into surround sound or to the separate "stems" needed for remixable audio.

The aim of this project is to develop a new approach to high quality audio repurposing, based on high quality musical audio source separation. To achieve this we will combine new high resolution separation techniques with information such as musical scores, instrument recognition, onset detection, and pitch tracking. Instead of aiming at generic source separation, we will develop algorithms designed to match the separation performance to the final target (upmixing or remixing). In parallel, we will investigate perceptual evaluation measures for source separation, remixing and upmixing, and develop new diagnostic evaluation techniques tailored to measure different aspects of the repurposed outcome.

The outcomes of this project will allow music consumers to enjoy their favourite songs in interactive remixing apps and games, even where the original separate "stems" are not available. It will also allow music companies, broadcasters and sound archive holders to provide high quality upmixed versions of their large archive content, for an increasing generation of listeners with surround sound systems in the home.
Key Findings
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Potential use in non-academic contexts
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Impacts
Description This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Summary
Date Materialised
Sectors submitted by the Researcher
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
Project URL:  
Further Information:  
Organisation Website: http://www.surrey.ac.uk