IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Speechreading using Modified Visual Feature Vectors

Speechreading using Modified Visual Feature Vectors
View Sample PDF
Author(s): Preety Singh (Malaviya National Institute of Technology, India), Vijay Laxmi (Malaviya National Institute of Technology, India)and M. S. Gaur (Malaviya National Institute of Technology, India)
Copyright: 2013
Pages: 24
Source title: Emerging Applications of Natural Language Processing: Concepts and New Research
Source Author(s)/Editor(s): Sivaji Bandyopadhyay (Jadavpur University, India), Sudip Kumar Naskar (Dublin City University, Ireland)and Asif Ekbal (Indian Institute of Technology Patna, India)
DOI: 10.4018/978-1-4666-2169-5.ch012

Purchase

View Speechreading using Modified Visual Feature Vectors on the publisher's website for pricing and purchasing information.

Abstract

Audio-Visual Speech Recognition (AVSR) is an emerging technology that helps in improved machine perception of speech by taking into account the bimodality of human speech. Automated speech is inspired from the fact that human beings subconsciously use visual cues to interpret speech. This chapter surveys the techniques for audio-visual speech recognition. Through this survey, the authors discuss the steps involved in a robust mechanism for perception of speech for human-computer interaction. The main emphasis is on visual speech recognition taking only the visual cues into account. Previous research has shown that visual-only speech recognition systems pose many challenges. The authors present a speech recognition system where only the visual modality is used for recognition of the spoken word. Significant features are extracted from lip images. These features are used to build n-gram feature vectors. Classification of speech using these modified feature vectors results in improved accuracy of the spoken word.

Related Content

Reinaldo Padilha França, Ana Carolina Borges Monteiro, Rangel Arthur, Yuzo Iano. © 2021. 21 pages.
Abdul Kader Saiod, Darelle van Greunen. © 2021. 28 pages.
Aswini R., Padmapriya N.. © 2021. 22 pages.
Zubeida Khan, C. Maria Keet. © 2021. 21 pages.
Neha Gupta, Rashmi Agrawal. © 2021. 20 pages.
Kamalendu Pal. © 2021. 14 pages.
Joy Nkechinyere Olawuyi, Bernard Ijesunor Akhigbe, Babajide Samuel Afolabi, Attoh Okine. © 2021. 19 pages.
Body Bottom