AI Based Sign Language Recognition System

Dooslin Mercy Bai V.*, Adithya K.**, Kartik Madankumar***, Kishore M.****, Vikram Venugopal Iyer*****
*-***** Department of Biomedical Engineering, Sri Shakthi Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India.
Periodicity:July - December'2024

Abstract

This study presents an AI-based system designed to facilitate communication between hearing-impaired and hearing individuals by translating sign language gestures into spoken English. The proposed system recognizes and decodes sign language motions captured through video inputs by utilizing deep learning techniques, specifically Convolutional Neural Networks (CNNs). The input video is first processed by the system using a variety of CNN models that have been trained to extract features. After identification, the signs are translated into appropriate text, which is then converted into speech by a Text-to-Speech (TTS) engine. The model can recognize various hand shapes, movements, and facial expressions, which are essential for accurate sign language interpretation, after being trained on a large dataset of annotated sign language gestures. Due to its real-time operation, the technology provides an effective communication method for individuals with hearing impairments. This approach offers a feasible solution for improving accessibility in social interactions, healthcare, education, and customer service by significantly reducing the communication barrier between hearing-impaired and hearing individuals.

Keywords

CNN, Deep Learning, Flask, TensorFlow, Google Colab, Python.

How to Cite this Article?

Bai, V. D. M., Adithya, K., Madankumar, K., Kishore, M., and Iyer, V. V. (2024). AI Based Sign Language Recognition System. i-manager’s Journal on Pattern Recognition, 11(2), 19-24.

References

[7]. Bai, Y., Park, S. Y., Kim, Y. S., Jeong, I. G., Ok, S. Y., & Lee, E. J. (2011). Hand tracking and hand gesture recognition for human computer interaction. Journal of Korea Multimedia Society, 14(2), 182-193.
[8]. Kulkarni, V. S., & Lokhande, S. D. (2010). Appearance based recognition of American sign language using gesture segmentation. International Journal on Computer Science and Engineering, 2(03), 560-565.
[10]. Pathak, A., Kumar, A., Gupta, P., & Chugh, G. (2022). Real time sign language detection. International Journal for Modern Trends in Science and Technology, 8(01), 32-37.
[12]. Sahoo, A. K., Mishra, G. S., & Ravulakollu, K. K. (2014). Sign language recognition: State of the art. ARPN Journal of Engineering and Applied Sciences, 9(2), 116-134.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Pdf 35 35 200 20
Online 15 15 200 15
Pdf & Online 35 35 400 25

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.