A New Dumb's Communication System

Abstract : Communication is one of the major principles to deal with the surrounding environment. The communication between people who are deaf or having an impaired hearing, with everyone around is difficult. This is due to the lack of the common language between both parties. Statistics and studies done by the World Health Organization showcases that 360 million people around the world suffer from hearing loss. Hearing loss is one of the major public health issues; that is considered to be the third most common physical condition after arthritis and heart disease. Dumb people communicate with others using their body language merely; especially their hand gestures. This communication mode is said to be complex, when dumb uses their manual-visual language. Though these languages are used, however, they do not have a typical origin and hence hard to interpret. Gesture recognition is the only way used to interpret and understand sign language. It depends on perceiving and interpreting movements based on Electromyography. For this purpose, we propose a way to transform the sign language of the dumb’s into an audio voice to convey their thoughts to others using Electromyography. Electromyography electrodes are utilized as a non-invasive wearable tool to provide clear, sensitive and accurate data for the muscle movement. For every movement there is a message. A database is collected for all the messages templates required. The motion sensor is placed on the dumb hand, while template database is fed into a microcontroller, in real time. Preliminary results showed that the Dumb’s system is capable of providing the comparison of every single motion registered with the database to produce the speech signal, based on matching gestures. A Text To Speech conversion block circuits, provided an interpretation to match the gestures. The device is not only interpreting alphabets but also sorting words produced by gestures. Dumb is capable of speaking like a normal person when undergoing the proper training and updating the database of this system.
Type de document :
Communication dans un congrès
23éme Conférence Scientifique Internationale La Science et la Recherche au Service de l'Homme, Apr 2017, Beyrouth, Lebanon. [Epub ahead of print], 2017
Liste complète des métadonnées

Littérature citée [6 références]  Voir  Masquer  Télécharger

http://www.hal.inserm.fr/inserm-01505492
Contributeur : Amira Zaylaa <>
Soumis le : mardi 11 avril 2017 - 13:51:44
Dernière modification le : vendredi 27 juillet 2018 - 11:26:05
Document(s) archivé(s) le : mercredi 12 juillet 2017 - 13:11:55

Fichier

LAAS_paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inserm-01505492, version 1

Collections

Citation

Lillian Al Tinnawi, Reem Harb, Hassan Nasser, Amira Zaylaa, Lara Hamawy. A New Dumb's Communication System. 23éme Conférence Scientifique Internationale La Science et la Recherche au Service de l'Homme, Apr 2017, Beyrouth, Lebanon. [Epub ahead of print], 2017. 〈inserm-01505492〉

Partager

Métriques

Consultations de la notice

1050

Téléchargements de fichiers

139