i-manager Publications

Design and Implementation of Voice, Touch and Gesture based Natural User Interface (NUI)

Arpitha D Apthi*, T. P. Chaitra**, P. Harish Kumar***, B. S. Jayabharathi****, K. Suresh*****

*-**** UG Student, Department of Electronics and Communication Engineering, KSSEM, Bengaluru, Karnataka, India.

***** Assistant Professor, Department of Electronics and Communication Engineering, KSSEM, Bengaluru, Karnadaka, India.

Periodicity:March - May'2017
DOI : https://doi.org/10.26634/jpr.4.1.13642

Abstract

Natural User Interface system is adopted by using the technology available for the purpose of controlling the devices as well as the systems used in the home automatically. For making the Natural User Interface system easy, the control of all the devices should be brought into one place, which makes home incredible. A variety of home devices can be controlled with the help of a Natural User Interface system.

Natural User Interface is built upon aiming to develop the most simple yet, highly efficient form of User interface having touch, voice, and human movements as the key elements. The traditional switches are upgraded with aid of Capacitive Touch Technology. Add-on like Voice is processed with the help of Voice Recognition (VR) module and Gestures are processed with Open Computer Vision Python (CV-Python) using Convex Hull algorithm. These controls are used in order to make it easy for any category of people to use the system with very minimal efforts. It has wide variety of applications and it can also be implemented in Industrial, Educational, Medical, Military Applications.

Keywords

Capacitive Touch Technology, VR Module, Open CV-Python, Convex Hull Algorithm

How to Cite this Article?

Apthi, D. A., Chaitra, T. P., Kumar, P. H., Jayabharathi, B. S., and Suresh, K. (2017). Design and Implementation of Voice, Touch and Gesture based Natural User Interface (NUI). i-manager’s Journal on Pattern Recognition, 4(1), 23-29. https://doi.org/10.26634/jpr.4.1.13642

References

[1]. Carpintero, E., Pérez, C., Morales, R., García, N., Candela, N., & Azorín, J. (2010). Development of a robotic scrub nurse for the operating theatre. 2010 3^rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, (pp. 504-509), Tokyo.

[2]. Davitadze, Z., Partenadze, G., & Djincharadze, E. (2016). Graphical visualization of data measurement of programmable microcontroller according to ARDUINOproject example. IEEE East-West Design & Test Symposium (EWDTS), Yerevan, 1-5.

[3]. de Oliveira, J. C., Santos, D. H., & Neto, M. P.,(2016). Chatting with Arduino platform through Telegram Bot. IEEE International Symposium on Consumer Electronics (ISCE), (131-132), Sao Paulo.

[4]. Ganapathyraju, S. (2013). Hand Gesture Recognition using convexity hull defects to control an industrial robot. 3^rd International Conference on Instrumentation Control and Automation (ICA), (63-67), Ungasan.

[5]. Nimbarte, M.M. (2011). Multi-Touch Screen Interfaces and Gesture Analysis: A Study. Advanced Computing: An International Journal (ACIJ ), 2.

[6]. Petroni, M., Collet, C., Fumai, N., Roger, K., Groleau, E., Yien, C., et al. (1991). An automatic speech recognition system for bedside data entry in an intensive care unit. In Circuits and Systems, 1990, Proceedings of the 33^rd Midwest Symposium on (pp. 791-794). IEEE.

[7]. Singh, A.K., Singh, R., & Dwivedi, A. (2014). Mel frequency cepstral coefficients based text independent Automatic Speaker Recognition using Matlab. Mel Frequency Cepstral Coefficients Based Text Independent Automatic Speaker Recognition using Matlab.

[8]. Xue, Y., Wang, L., Li, L., Liu, Z., & Liu, J. (2016). Matlab- Based Intelligent Voiceprint Recognition System. Sixth International Conference on Instrumentation & Measurement, Computer, Communication and Control (IMCCC), (pp. 303-306), Harbin.

[9]. Yamagishi, K., Jing, L., & Cheng, Z. (2014). A system for controlling personal computers by Hand Gestures using a Wireless Sensor Device. IEEE International Symposium on Independent Computing (ISIC), (pp.1-7) Orlando, FL.

[10]. Yorozu, Y., Hirano, M., Oka, K., & Tagawa, Y. (1987). Electron Spectroscopy Studies on Magneto-Optical Media and Plastic Substrate Interface. IEEE Translation Journal of Magnetics in Japan, 2(8), 740-741.

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.