i-manager Publications

A Novel Communication System Based on Sign Language Recognition and Voice Conversion for Differently Abled Person

Sandhiya J. A. L.*, Pugalvani S.**, Sowmiya S. S.***, Vishalini C.****

*-**** Department of Biomedical Engineering, Gnanamani College of Technology, Namakkal, Tamil Nadu, India.

Periodicity:January - June'2024
DOI : https://doi.org/10.26634/jdp.12.1.20914

Abstract

Sign language is a form of communication that helps deaf and mute people interact with those who can hear. In the country, around 2.78% of people are unable to speak, i.e., are mute or deaf. Their primary means of communication is through hand motions and gestures. The paper proposes a new technique called the "artificial speaking mouth" for individuals with speech impairments. Humans connect with each other through thoughts and ideas, but some people lack the ability to speak. For them, sign language is the only means of communication. Nowadays, technology has reduced this communication gap with systems that translate sign language into speech. Sign Language Recognition (SLR) and gesture-based control are two major applications used for hand gesture recognition technologies. On the other hand, the controller converts sign language into text and speech, using text-to-speech conversion and analog-to-digital conversion.

Keywords

Sign Language Recognition, Voice Conversion Technology, Assistive Communication Systems, Augmentative and Alternative Communication (AAC), Speech-to-Text Translation, Sign Language Interpretation.

How to Cite this Article?

Sandhiya, J. A. L., Pugalvani, S., Sowmiya, S. S., and Vishalini, C. (2024). A Novel Communication System Based on Sign Language Recognition and Voice Conversion for Differently Abled Person. i-manager’s Journal on Digital Signal Processing, 12(1), 28-32. https://doi.org/10.26634/jdp.12.1.20914

References

[1]. Abedin, T., Prottoy, K. S., Moshruba, A., & Hakim, S. B. (2023). Bangla sign language recognition using a concatenated bdsl network. In Computer Vision and Image Analysis for Industry 4.0 (pp. 76-86). Chapman and Hall/CRC.

[2]. Ambavane, P., Karjavkar, R., Pathare, H., Relekar, S., Alte, B., & Sharma, N. K. (2020). A novel communication system for deaf and dumb people using gesture. In ITM Web of Conferences, 32, 02003. EDP Sciences.

[3]. Dubey, P., & Shrivastav, M. P. (2021a). Sign language conversion flex sensor based on IOT. International Journal of Research in Engineering and Science (IJRES), 9 (2), 69-71.

[4]. Dubey, P., & Shrivastav, M. P. (2021b). Iot based sign language conversion. International Journal of Research in Engineering and Science (IJRES), 9(2), 84-89.

[5]. Gireesh Babu, C. N., & Thungamani, M. (2022). Effective communication between differently abled and normal people using speech to sign translation system. Journal of Pharmaceutical Negative Results (pp. 1078-1084).

[6]. Kokkonis, G., Gounopoulos, E., Tsiamitros, D., Stimoniaris, D., & Fragulis, G. F. (2020). Designing interconnected haptic interfaces and actuators for teleoperations in mobile ad hoc networks. International Journal of Entertainment Technology and Management, 1(1), 43-63.

[7]. Lee, C. K., Ng, K. K., Chen, C. H., Lau, H. C., Chung, S. Y., & Tsoi, T. (2021). American sign language recognition and training method with recurrent neural network. Expert Systems with Applications, 167, 114403.

[8]. Papatsimouli, M., Lazaridis, L., Kollias, K. F., Skordas, I., & Fragulis, G. F. (2020). Speak with signs: Active learning platform for Greek Sign Language, English Sign Language, and their translation. arXiv preprint arXiv:2012.11981.

[9]. Pezzuoli, F., Tafaro, D., Pane, M., Corona, D., & Corradini, M. L. (2020). Development of a new sign language translation system for people with autism spectrum disorder. Advances in Neurodevelopmental Disorders, 4, 439-446.

[10]. Punsara, K. K. T., Premachandra, H. H. R. C., Chanaka, A. W. A. D., Wijayawickrama, R. V., & Nimsiri, A. (2020, December). IoT based sign language recognition system. In 2020 2nd International Conference on Advancements in Computing (ICAC), 1, 162-167). IEEE.

[11]. Rajapandian, B., Harini, V., Raksha, D., & Sangeetha, V. (2017, May). A novel approach as an AID for blind, deaf and dumb people. In 2017 Third International Conference on Sensing, Signal Processing and Security (ICSSS) (pp. 403-408). IEEE.

[12]. Rizwan, S. B., Khan, M. S. Z., & Imran, M. (2019, August). American sign language translation via smart wearable glove technology. In 2019 International Symposium on Recent Advances in Electrical Engineering (RAEE) (Vol. 4, pp. 1-6). IEEE.

[13]. Sideridis, V., Zacharakis, A., Tzagkarakis, G., & Papadopouli, M. (2019, September). Gesturekeeper: Gesture recognition for controlling devices in iot environments. In 2019 27th European Signal Processing Conference (EUSIPCO) (pp. 1-5). IEEE.

[14]. Syed, S., Chagani, S., Hafeez, M., Timothy, S., & Zahid, H. (2018, October). Sign recognition system for differently abled people. In TENCON 2018-2018 IEEE Region 10 Conference (pp. 1148-1153). IEEE.

[15]. Zhou, Z., Chen, K., Li, X., Zhang, S., Wu, Y., Zhou, Y., & Chen, J. (2020). Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays. Nature Electronics, 3(9), 571-578.

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.