Sign language voice convertor design using Raspberry pi for impaired individuals

Abstract

In this study, a method for detecting sign language is created to help people with speech and hearing impairments communicate more effectively with each other and with people who do not know sign language. One of the applications of flexible sensors for the development of interaction/interface devices based on human gestures is the translation of sign language into audio. Resistive flexible sensors can be used in a wide variety of applications due to their light weight, compact form, flexibility, measurement efficiency and low power consumption. The design is outlined in Proteus simulation environment by connecting five flexible sensors, a switch and an LCD display to a Raspberry pi. Each finger gesture combination in the generated system represents a separate character or phrase. In digital electronics, these combinations are digital sets consisting of logic 0 and logic 1. Finger signals corresponding to the characters or sentences to be used in the study are given to the developed system. The sensor output is converted to digital form using Raspberry Pi and after processing the data, audio output is generated using gTTS. For each combination of finger movements made by the user, a character or sentence presented to the system is transferred to the LCD screen. The aim of this study is to help bridge the communication gap between sign language users and non-sign language speakers.