Multimodal Signal Processing

Theory and Applications for Human-Computer Interaction

Jean-Philippe Thiran, Ferran Marqués, Hervé Bourlard, Jean-Philippe Thiran, Ferran Marqués, Hervé Bourlard

• Publisher: Academic Press
• Year: 2009
• ISBN:
  9780080888699
• Topic: Computer Science
• Subtopic: Human-Computer Interaction
• Index: Computer Science

Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems.

With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field.

• Presents state-of-art methods for multimodal signal processing, analysis, and modeling
• Contains numerous examples of systems with different modalities combined
• Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.