Sign Language Recognition using sEMG and IMU

Abstract

The voiceless community of our society use sign language to communicate their views to the general public. Sign Language is basically making gestures by combining arm and hand movement along various orientations with facial expression to convey what they want to communicate. Since the general public do not have the knowledge of Sing Language it becomes difficult for the voiceless community to interface with general public. We have tried to bridge this communication gap for the Indian population by providing a system which gives voice to the voiceless community. We propose a system which converts the hand gestures performed by a person to text. The Signs will be from the Indian Sign Language and will correspond to each letter in the English alphabet. This system will be equipped with Inertial Measurement Unit(IMU) and the surface electromyography(sEMG) signal will be picked from the surface of the forehand in order to perform a sensor fusion of the data collected from the two different sources. The data collected will be fed to the classifier algorithm of Support Vector Machine(SVM).The detected Sign Language gesture will be displayed on a display as Text.