Real Time Characterization of Lip-Movements Using Webcam

Suresh D S¹, Sandesh C²

CIT, Gubbi, Tumkur, Karnataka

Abstract

Communication plays an important role in the day-to-day activities of human being. The main objective of this paper is to help the people who are unable to speak. Visual speech plays a major role in the lip-reading for listeners with deaf person. Here we are using local spatiotemporal descriptors in order to identify or recognize the words or phrases from the disable (dumb) people by their lip-movements. Local binary patterns extracted from the lip movements are used to recognize the isolated phrases. Experiments were made on ten speakers with 5 phrases and obtained accuracy of about 75% for speaker dependent and 65% for speaker independent. While being made comparison with other concepts like AV letter database, our method outperforms the other by accuracy of 65%. The advantages of our method are robustness and recognition is possible in real time.

Keywords

Author's Profile

Author profile can be generated and linked through our partners World Book of Researchers. To include your profile online Click Here. After it is approved, please email to edlib @ asdf.res.in to create a link with all the papers.

• Suresh D S : Profile
• Sandesh C : Profile

e-AID

Cite this Article as Follows

Suresh D S, Sandesh C. Real Time Characterization of Lip-Movements Using Webcam. National Conference on Man Machine Interaction 2014. Vol. 1. Chennai: Association of Scientists, Developers and Faculties, 2014. 34-39. Print.