Chris Davis, University of Western Sydney
Visual speech information (derived from viewing the movement of the lips, jaw, and other facial gestures as well as head movements during speech production) when combined with hearing (i.e., AV speech) enables the speech signal to be robust and resistant to noise and hearing loss. This workshop will review theoretical and empirical issues relating to multimodal information in speech and in communication more generally.
-
Some of the topics in this Summer School unit will be:
-
An introduction to multimodal aspects of the speech signal
-
A consideration of the development of AV speech perception (e.g., infants as young as 18 weeks of age show sensitivity to both audible speech and visual speech).
-
AV speech perception in people with sensory impairment (deafness).
-
The use visual information to enhance speech perception in normal hearing people.
This workshop will:
-
Provide a general overview of current research in the field of audio-visual speech processing.
-
Provide students with a basic understanding of audio-visual speech production and perception
-
Place AV speech processing within a larger domain of multimodal perception and a memory and prediction framework.
Materials
