3-D Audio with Video Tracking for Multimedia Environments

Аннотация

This paper deals with a 3-D audio system that has been developed for desktop multimedia environments. The system has the ability to place virtual sources at arbitrary azimuths and elevations around the listener’s head. It is based on HRTF binaural synthesis. A listener seated in front of a computer and two loudspeakers placed at each side of the monitor have been considered. Transaural reproduction using loudspeakers has been used to render the sound field to listener ears. Furthermore the system can cope with slight movements of the listener head. Head position is monitored by means of a simple computer vision algorithm. Four head position coordinates (x,y,z,f) are continuously estimated in order to allow free movements of the listener. Cross-talk cancellation filters and virtual source locations are updated depending on these head coordinates.