Indian Sign Language Recognition System using Openpose

Pooja Malhotra*, Chirag K. Maniar**, Nikhil V. Sankpal***, Hardik R. Thakkar****
*-**** Department of Information Technology, K.J. Somaiya College of Engineering, Mumbai University, Mumbai, Maharashtra, India.
Periodicity:June - August'2019
DOI : https://doi.org/10.26634/jcom.7.2.15993

Abstract

Human beings communicate through language, be it verbal or be it a sign language that makes use of body motion. Hearing and Speech impaired people, having no way to communicate verbally, make use of Sign Language. They perform gestures using a sign language in order to convey their message and effectively communicate with each other. Since, not everyone knows about Indian Sign Language (ISL), it becomes difficult for normal people to fluently communicate with Hearing and Speech impaired community. This paper proposes ISL gesture recognition system in order to decrease this communication gap. The dataset consists of videos of ISL gestures, which are performed by different Subjects. The proposed system uses OpenPose library, which helps in creating the skeleton of human body and thus it provides keypoints of the whole human body frame by frame. The use of this library removes the dependency on lighting conditions and background. It helps in focusing on just the gesture movements. After extracting the keypoints, Long Short Term Memory (LSTM) is used for classification of gestures. LSTM model classifies which ISL gesture the particular video belongs to.

Keywords

Indian Sign Language (ISL), OpenPose, Keypoints, Skeleton, Long Short Term Memory (LSTM).

How to Cite this Article?

Malhotra, P., Maniar, C. K., Sankpal, N. V., Thakkar, H. R. (2019). Indian Sign Language Recognition System using Openpose, i-manager's Journal on Computer Science, 7(2), 43-50. https://doi.org/10.26634/jcom.7.2.15993

References

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

If you have access to this article please login to view the article or kindly login to purchase the article
Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.