| EPSRC Reference: |
EP/D033772/1 |
| Title: |
Multi-modal object tracking in a network of audiovisual sensors |
| Principal Investigator: |
Cavallaro, Professor A |
| Other Investigators: |
|
| Researcher Co-Investigators: |
|
| Project Partners: |
|
| Department: |
Sch of Electronic Eng & Computer Science |
| Organisation: |
Queen Mary University of London |
| Scheme: |
First Grant Scheme Pre-FEC |
| Starts: |
01 August 2006 |
Ends: |
31 July 2008 |
Value (£): |
125,526
|
| EPSRC Research Topic Classifications: |
| Digital Signal Processing |
Image & Vision Computing |
| Mobile Computing |
Multimedia |
|
| EPSRC Industrial Sector Classifications: |
| Healthcare |
Creative Industries |
|
| Related Grants: |
|
| Panel History: |
|
|
Summary on Grant Application Form |
|
The aim of this project is to develop a unified scheme cooperative multi-modal and multi-sensor tracking. The multi-sensor network will be composed of stereo microphones coupled with omni-directional and with pan-tilt-zoom cameras. Sound information will be used to discriminate ambiguous visual observations as well as to extend the coverage area of the sensors beyond the field of view of the cameras. Although single modality as well as multi-modality trackers have achieved some success, a number of important tracking issues remain open for enabling the adoption of these algorithms in real-world scenarios. Among these issues, three important inter-related problems will be addressed in this project, namely the definition of a generic and flexible feature representation for a target, a reliable mechanism to update the target model based on incoming observations, and a robust multi-sensor handover strategy. First, we will develop a robust and adaptive representation of objects based on their acoustical and visual attributes while moving across the network of heterogeneous sensors. Next, object models will be defined based on the observation that temporal representation of a target is expected to lie in a low-dimensional manifold in the high-dimensional multi-modal feature space. Finally, the object model will be used to control and guide the evolution of the target state in order to help intra-sensor occlusion handling and inter-sensor handover. To evaluate the tracking scheme, we will create a test corpus and its associated ground-truth data for use in the project as well as for distribution to the research community to facilitate comparisons.
|
|
Key Findings |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
|
Potential use in non-academic contexts |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
|
Impacts |
|
| Description |
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk |
| Summary |
|
| Date Materialised |
|
|
|
|
Sectors submitted by the Researcher |
|
This information can now be found on Gateway to Research (GtR) http://gtr.rcuk.ac.uk
|
| Project URL: |
|
| Further Information: |
|
| Organisation Website: |
|