Sensor Based Sign Language Recognition System

Alka Mishra*, Abhilash Jacob Mathew**, Abhyudaya Agrawal***, Adnan Quarishi****, Amiy Vaishnava*****, Sparsh Kumar******
*-******Department of Electrical and Electronics Engineering, Bhilai Institute of Technology, Durg, Chhattisgarh, India.
Periodicity:January - June'2022
DOI : https://doi.org/10.26634/jpr.9.1.18757

Abstract

Sign language is used as a primary form of communication by many people who are deaf, deafened and non-verbal. Communication barriers exist for members of these populations during daily interactions with those who are unable to understand or use sign language. Advancements in technology and machine learning techniques have enabled development of innovative approaches to translate these sign languages to spoken languages. This paper proposes an intelligent system for translating sign language into text. This approach consists of hardware as well as software. The hardware consists of flex, contact, inertial sensors and SD card module mounted on a synthetic glove, additionally If-Else (Rule based learning) based learning is performed by Arduino nano (Atmega328p) to represent the proposed system. This system is able to recognize static letters, numbers and translating 26 letters from A to Z and 10 numbers from 0 to 9 from the American sign language. The database with the use of alphabet and numbers is prepared, and tested by kNN and CN2 rule inducer, where kNN has shown promising result. This experiment is done by Orange software. Experimental results demonstrate that our system is effective, cheaper and has high classification accuracy as compared to other technology available in market.

Keywords

Gesture Recognition, Machine Learning, Sensor-based Glove, Sign Language Translation.

How to Cite this Article?

Mishra, A., Mathew, A. J., Agrawal, A., Quarishi, A., Vaishnava, A., and Kumar, S. (2022). Sensor Based Sign Language Recognition System. i-manager’s Journal on Pattern Recognition, 9(1), 15-22. https://doi.org/10.26634/jpr.9.1.18757

References

[1]. Ahmed, M. A., Zaidan, B. B., Zaidan, A. A., Salih, M. M., & Lakulu, M. M. B. (2018). A review on systems-based sensory gloves for sign language recognition state of the art between 2007 and 2017. Sensors, 18(7), 2208. https://doi.org/10.3390/s18072208
[2]. Clark, P., & Niblett, T. (1989). The CN2 induction algorithm. Machine Learning, 3(4), 261-283. https://doi.org/10.1023/A:1022641700528
[3]. Dutta, K. K., & Bellary, S. A. S. (2017). Machine learning techniques for Indian sign language recognition. In 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), 333-336. https://doi.org/10.1109/CTCEEC.2017.8454988
[4]. Lopez, I. V. (2017). Hand Gesture Recognition for Sign Language Transcription.
[5]. Ma, H., Wang, Q., Ma, X., & Salem, M. E. (2020). A sign language interaction system based on pneumatic soft hand. In 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA), 568-573. https://doi.org/10.1109/ICIEA48937.2020.9248247
[6]. Nazib, R. A., Ahmed, T., Siddique, N., & Tusher, J. H. (2017). Sign Language Conversion and Training by Machine Learning with an IOT approach (Doctoral dissertation, BRAC University).
[7]. Nimisha, K. P., & Jacob, A. (2020). A brief review of the recent trends in sign language recognition. In 2020 International Conference on Communication and Signal Processing (ICCSP), 186-190. https://doi.org/10.1109/ICCSP48568.2020.9182351
[8]. Ramli, S. (2012). GMT feature extraction for representation of BIM sign language. In 2012 IEEE Control and System Graduate Research Colloquium, 43-48. https://doi.org/10.1109/ICSGRC.2012.6287133
[9]. Weiss, S. M., & Indurkhya, N. (1995). Rule-based machine learning methods for functional prediction. Journal of Artificial Intelligence Research, 3, 383-403. https://doi.org/10.1613/jair.199
[10]. Welch, G., & Bishop, G. (2006). An introduction to the Kalman filter. University of North Carolina at Chapel Hill, 1-16.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.