Hand Gesture to Speech and Text Conversion Device
K. P. Vijayakumar1, Ananthu Nair2, Nishant Tomar3
1Dr. K P Vijayakumar*, Assitant Professor, Department of Computer Science and Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai.
2Ananthu Nair, Undergraduate Student, Department of Computer Science and Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai.
3Nishant Tomar, Undergraduate Student, Department of Computer Science and Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai.
Manuscript received on February 10, 2020. | Revised Manuscript received on February 23, 2020. | Manuscript published on March 10, 2020. | PP: 1241-1246 | Volume-9 Issue-5, March 2020. | Retrieval Number: E2260039520/2020©BEIESP | DOI: 10.35940/ijitee.E2260.039520
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Sign language and facial expressions are the major means of communication for the speech flawed people. General people can understand the facial expression to an extent but cannot understand the sign language. Dumb people are unable to express their thoughts to normal humans. To reduce this gap of communication, this paper presents an electronic system which will help the mute people to exchange their ideas with the normal person in emergency situations. The system consists of a glove that can be worn by the subject which will convert the hand gestures to speech and text. The message displayed will also help deaf people to understand their thoughts. This prototype involves raspberry pi 3 as the micro-controller along with the flex sensors, accelerometer sensor. The resistance of the flex sensor changes due to the bending moment of the fingers of the subject. The accelerometer measures the angular displacement of the wrist along the y-axis. The microcontroller takes the input from the two sensors and matches it with the pre-programmed values and plays the respective message. The system makes use of python and its libraries for microcontroller programming.
Keywords: Flex Sensor, Accelerometer, pyttsx3, Raspberry Pi, Analog to Digital Converter (ADC).
Scope of the Article: Process & Device Technologies