Menu Content/Inhalt
SFB 673 arrow Events
CRC Colloquium
show month-view show week-view   
Integrating Audio-Visual Information for the Control of Overt Attention
Montag, 14.05.2007 16:00 - 18:00
Peter König, Universität Osnabrück
Institut für Kognitionswissenschaft
- Neurobiopsychologie -


http://www.cogsci.uni-osnabrueck.de/~NBP/peterhome.html

"Integrating Audio-Visual Information for the Control of Overt Attention"

During free exploration of the environment, different sources of information interact in the control of overt attention. In this work, by recording eye movements of human subjects during free viewing of natural multimodal stimuli, we investigated these interaction mechanisms. We presented natural images associated with localized natural sounds in a variety of conditions. We demonstrate that the selection of fixation points during multimodal conditions is dependent on both unimodal stimuli. Further analysis shows that a linear combination of both unimodal signals with a slight facilitatory component provides a good model for this integration process. Hence our results posit toward the direction of a joint saliency map integrating different saliencies before any decision is taken about the subsequent fixation point. These results provide boundaries for the performance and architecture of any overt attention model performing in multimodal conditions.
Contact
contact-person: Ipke Wachsmuth
homepage: ariadne.coli.uni-bielefeld.de