A New Dumb's Communication System - Inserm - Institut national de la santé et de la recherche médicale Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

A New Dumb's Communication System

Résumé

Communication is one of the major principles to deal with the surrounding environment. The communication between people who are deaf or having an impaired hearing, with everyone around is difficult. This is due to the lack of the common language between both parties. Statistics and studies done by the World Health Organization showcases that 360 million people around the world suffer from hearing loss. Hearing loss is one of the major public health issues; that is considered to be the third most common physical condition after arthritis and heart disease. Dumb people communicate with others using their body language merely; especially their hand gestures. This communication mode is said to be complex, when dumb uses their manual-visual language. Though these languages are used, however, they do not have a typical origin and hence hard to interpret. Gesture recognition is the only way used to interpret and understand sign language. It depends on perceiving and interpreting movements based on Electromyography. For this purpose, we propose a way to transform the sign language of the dumb’s into an audio voice to convey their thoughts to others using Electromyography. Electromyography electrodes are utilized as a non-invasive wearable tool to provide clear, sensitive and accurate data for the muscle movement. For every movement there is a message. A database is collected for all the messages templates required. The motion sensor is placed on the dumb hand, while template database is fed into a microcontroller, in real time. Preliminary results showed that the Dumb’s system is capable of providing the comparison of every single motion registered with the database to produce the speech signal, based on matching gestures. A Text To Speech conversion block circuits, provided an interpretation to match the gestures. The device is not only interpreting alphabets but also sorting words produced by gestures. Dumb is capable of speaking like a normal person when undergoing the proper training and updating the database of this system.
Fichier principal
Vignette du fichier
LAAS_paper.pdf (346.51 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inserm-01505492 , version 1 (11-04-2017)

Identifiants

  • HAL Id : inserm-01505492 , version 1

Citer

Lillian Al Tinnawi, Reem Harb, Hassan Nasser, Amira J Zaylaa, Lara Hamawy. A New Dumb's Communication System. 23éme Conférence Scientifique Internationale La Science et la Recherche au Service de l'Homme, L'Association Libanaise pour l'Avancement des Sciences et la Faculté des Sciences de l'Université Libanaise en collaboration avec Le Conseil National de La Recherche Scientifique au Liban Apr 2017, Beyrouth, Lebanon. [Epub ahead of print]. ⟨inserm-01505492⟩

Collections

INSERM
1071 Consultations
638 Téléchargements

Partager

Gmail Facebook X LinkedIn More