- English
- PDF
- Available on iOS & Android
Audiovisual Speech Processing
About this book
When we speak, we configure the vocal tract which shapes the visible motions of the face and the patterning of the audible speech acoustics. Similarly, we use these visible and audible behaviors to perceive speech. This book showcases a broad range of research investigating how these two types of signals are used in spoken communication, how they interact, and how they can be used to enhance the realistic synthesis and recognition of audible and visible speech. The volume begins by addressing two important questions about human audiovisual performance: how auditory and visual signals combine to access the mental lexicon and where in the brain this and related processes take place. It then turns to the production and perception of multimodal speech and how structures are coordinated within and across the two modalities. Finally, the book presents overviews and recent developments in machine-based speech recognition and synthesis of AV speech.
Frequently asked questions
- Essential is ideal for learners and professionals who enjoy exploring a wide range of subjects. Access the Essential Library with 800,000+ trusted titles and best-sellers across business, personal growth, and the humanities. Includes unlimited reading time and Standard Read Aloud voice.
- Complete: Perfect for advanced learners and researchers needing full, unrestricted access. Unlock 1.4M+ books across hundreds of subjects, including academic and specialized titles. The Complete Plan also includes advanced features like Premium Read Aloud and Research Assistant.
Please note we cannot support devices running on iOS 13 and Android 7 or earlier. Learn more about using the app.
Information
Table of contents
- Cover
- Audiovisual Speech Processing
- Title
- Copyright
- Dedication
- Contents
- Figures
- Tables
- Contributors
- Preface
- Acknowledgments
- Introduction
- 1: Three puzzles of multimodal speech perception
- 2: Visual speech perception
- 3: Dynamic information for face perception
- 4: Investigating auditory-visual speech perception development
- 5: Brain bases for seeing speech: fMRI studies of speechreading
- 6: Temporal organization of Cued Speech production
- 7: Bimodal perception within the natural time-course of speech production
- 8 Visual and audiovisual synthesis and recognition of speech by computers
- 9: Audiovisual automatic speech recognition
- 10: Image-based facial synthesis
- 11: A trainable videorealistic speech animation system
- 12: Animated speech: research progress and applications
- 13: Empirical perceptual-motor linkage of multimodal speech
- 14: Sensorimotor characteristics of speech production
- Notes
- References
- Index