Robot Control using Hand Gesture

U. B. Mahadevaswamy*, Anusha H. N**
*-** Department of Electronics and Communication, JSSS & TU, Mysuru, India.
Periodicity:March - May'2019


Hand controllers and electromechanical devices have been used by humans to control robots or machines but there were some constraints in several factors of interaction. Pattern recognition and Gesture recognition are the growing fields of analysis. Hand gesture recognition is very significant for human-computer interaction (HCI). In this work, we present a completely unique real-time methodology for robot control using hand gesture recognition. It is necessary for the user to communicate and control a device in the natural efficient way in human-robot interaction based. The implementation is done using Kinect sensor and Matlab environment. The robot arm is controlled by Firebird V robot. We have implemented a prototype using gesture as a tool for communication with ma-chine command signals are generated using gesture control algorithm. These generated signals are then given to the robot to perform a set of task. This Kinect sensor recognizes the hand gestures and then assigns functions to be performed by the robot for each hand gesture.


Hand Gesture Recognition, HOG, SVM, Matlab, Kinect Sensor, Firebird V Robot.

How to Cite this Article?

Mahadevaswamy , U., B., Anusha, H., N. (2019). Overview Robot Control Using Hand Gesture.i-manager’s Journal on Pattern Recognition, 6(1), 11-26.


[1]. Agrawal, R., & Gupta, N. (2016, February). Real time hand gesture recognition for Human Computer Interaction. In 2016 IEEE 6th International Conference on Advanced Computing (IACC) (pp. 470-475). IEEE.
[2]. Anju, S. R., & Surendran, S. (2014). A study on different hand gesture recognition techniques. International Journal of Engineering Research & Technology, 3(4), 2275-2278.
[3]. Ansari, F. J. (2017). Hand Gesture Recognition using fusion of SIFT and HoG with SVM as a Classifier. International Journal of Engineering Science and Research, 4(9), 1-10.
[4]. Charayaphan, C., & Marble, A. E. (1992). Image processing system for interpreting motion in American Sign Language. Journal of Biomedical Engineering, 14(5), 419-425.
[5]. Chen, Z. H., Kim, J. T., Liang, J., Zhang, J., & Yuan, Y. B. (2014). Real-time hand gesture recognition using finger segmentation. The Scientific World Journal, 2014.
[6]. Ingle, C. P., Patil, R. N., & Patel, N. R., (March 2018). Adaptive motion control of firebird V robot. International Journal of Computer Science and Mobile Computing, 7(3), 82-87.
[7]. Jais, H. M., Mahayuddin, R. Z., & Arshad, H. (2015 August). A review on gesture recognition using Kinect. The 5th International Conference on Electrical Engineering and Informatics (pp.594-599).
[8]. Jones, M. J., & Rehg, J. M. (1999). “Statistical color model models with application to skin detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99), (Vol 1, No 1, 274-280),
[9]. Kishore, P. V. V., Rao, G. A., Kumar, E. K., Kumar, M. T. K., & Kumar, D. A. (2018). Selfie sign language recognition with convolutional neural networks. International Journal of Intelligent Systems and Applications, 10(10), 63-71.
[10]. Ma, X., & Peng, J. (2018). Kinect sensor-based longdistance hand gesture recognition and fingertip detection with depth information. Journal of Sensors, 2018.
[11]. Nagashree, R. N., Michahial, S., Aishwarya, G. N., Azeez, B. H., Jayalakshmi, M. R., & Rani, R. K. (2005). Hand gesture recognition using Support Vector Machine. International Journal of Engineering and Science, 4(6), 42-46.
[12]. Pagi, T., & Padmajothi, V. (2017). Gesture based robotic arm control using hand movements. International Journal of Pure and Applied Mathematics, 115(7), 649- 655.
[13]. Patil, A. R., & Subbaraman, S. S. (2012). A review on vision based hand gesture recognition approach using Support Vector Machines. IOSR Journal of Electronics and Communication Engineering, 7-12.
[14]. Ren, Z., Yuan, J., Meng, J., & Zhang, Z. (2013). Robust part-based hand gesture recognition using Kinect sensor. IEEE Transactions on Multimedia, 15(5), 1110- 1120.
[15]. Sankpal, A., Chawan, S., Shaikh, S., & Tisekar, A., (March 2016). Collaborative wireless gesture controlled robotic system. International Journal of Advanced Research in Computer and Communication Engineering, 5(3), 513-516.
[16]. Sheenu, Garima Joshi, & Renu Vig. (2015). Histograms of orientation gradient investigation for static hand gestures. International Conference on Computing, Communication and Automation, pp.1100-1103, doi: 10.1109/CCAA.2015.7148539
[17]. Starner, T., Weaver, J., & Pentland, A. (1998). Realtime american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12), 1371- 1375.
[18]. Wang, Y., Song, G., Qiao, G., Zhang, Y., Zhang, J., & Wang, W. (2013, December). Wheeled robot control based on gesture recognition using the Kinect sensor. In 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO) (pp. 378-383). IEEE.
[19]. Xu, P. (2017). A real-time hand gesture recognition and human-computer interaction system. arXiv preprint arXiv:1704.07296.

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

If you have access to this article please login to view the article or kindly login to purchase the article
Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.