期刊名称：Journal of Theoretical and Applied Information Technology
印刷版ISSN：1992-8645
电子版ISSN：1817-3195
出版年度：2014
卷号：62
期号：3
出版社：Journal of Theoretical and Applied
摘要：The speech impaired communicates with normal people in everyday life and they use sign language for communication, but they find difficulty in communicating with others who do not understand sign language. And often they need a support for effective communication and this work aimed to lower this barrier in communication. It is based on the need of developing an electronic device that can translate sign language into speech and text, in order to make the communication take place between the mute communities with the general public. Most of the existing systems are image based gesture recognition system and hence highly expensive, whereas this work has developed a low cost Glove based system. The developed system is a complete portable communication aid for the speech impaired which includes converting the sign language in to speech and text, sending the same as message through GSM and controlling the home appliances through hand gesture. In which a hand glove with a 3 axis MEMS and Flex sensor is connected to the ADC channels of the LPC 2138 Microcontroller (M1). The output values from the MEMS and Flex sensor are transmitted to another LPC 2138 microcontroller (M2) at the receiver section through the XBee module. At the receiver section there are two modes namely, teach and play mode and the desired mode is selected through the switch, which is interfaced with the microcontroller. The first mode is the teach mode, in which the microcontroller stores the sign values in EEPROM corresponding to a letter or word, along with an address and the corresponding voice is recorded in voice IC (APR6016). The second one is the play mode, in which the microcontroller recognizes the sign for the corresponding letter/word and plays back the sound values from the voice IC. The letter or word is then displayed on the LCD and a SMS (Short Message Service) is sent through the GSM modem. The device connected to the relay can be turned ON / OFF as per the sign values stored in the teach mode. is the teach mode, in which the microcontroller stores the sign values in EEPROM corresponding to a letter or word, along with an address and the corresponding voice is recorded in voice IC (APR6016). The second one is the play mode, in which the microcontroller recognizes the sign for the corresponding letter/word and plays back the sound values from the voice IC. The letter or word is then displayed on the LCD and a SMS (Short Message Service) is sent through the GSM modem. The device connected to the relay can be turned ON / OFF as per the sign values stored in the teach mode.
关键词：APR6016; ASL; Communication aid; GSM; MEMS; XBee
