Development of an Intelligent Assistant for Legally Blind Individuals

Sheila A. Abaya*, Juan Miguel Castillo **, Hazel Dayupay***, Christopher Espero****, Ramon Ricardo Garcia*****, Mamer Mangahas******
* Department of Computer Studies and System, University of the East, Caloocan, Philippines.
**-****** Department of Information Technology, University of the East, Caloocan Campus, Philippines.
Periodicity:July - December'2019
DOI : https://doi.org/10.26634/jmt.6.2.17352

Abstract

Visual impairment was defined as the limitation of actions and functions of the visual system. It may cause an individual's difficulty in carrying out their normal daily activities such as driving, reading, socializing, and walking. Technology innovation plays a major part in our lives today and can be utilized for many purposes and one of which is an aid for Legally Blind Persons (LBP) suffering from the defect of visual impairment. The main focus of this work is to develop an application which will help the LBP in recognizing objects, color and text using only the mobile camera. Machine learning was implemented in the study using the platform of TensorFlow. The network of algorithms or artificial neural network was also integrated into the work, thus the application has the capability of providing different interpretation of data captured by the mobile camera through deep learning. To validate the effectiveness and efficiency of work, it was evaluated by several individuals using the following criteria: Usability, Accuracy and Assistance and the result was interpreted using the Likert scale values. Overall result was 4.33 interpreted as outstanding, thus concluded that the work met the targeted individuals' expectations and requirements and that it is acceptable.

Keywords

Deep Learning, Machine Learning, TensorFlow, Visual Impairment, Legally Blind Persons.

How to Cite this Article?

Abaya, S. A., Castillo, J. M., Dayupay, H., Espero, C., Garcia, R. R., and Mangahas, M. (2019). Development of an Intelligent Assistant for Legally Blind Individuals. i-manager’s Journal on Mobile Applications and Technologies , 6(2), 12-20. https://doi.org/10.26634/jmt.6.2.17352

References

[1]. Ahlawat, S., & Dahiya, R. (2013). A Novel Approach of Text to Speech Conversion Under Android Environment. International Journal of Computer Science Management Studies (IJCSMS), 13(5),189 – 193.
[2]. Bouillon, M., Ingold, R., & Liwicki, M. (2019). Grayification: A meaningful grayscale conversion to improve handwritten historical documents analysis. Pattern Recognition Letters, 121, 46-51. https://doi.org/10.1016/j. patrec.2018.05.021
[3]. California Optometric Association. (2019). Common types of visual impairment. https://www.coavision.org/m/ pages.cfm?pageid=3625
[4]. Congdon, N., O'Colmain, B., Klaver, C. C., Klein, R., Muñoz, B., Friedman, D. S., ... & Mitchell, P. (2004). Causes and prevalence of visual impairment among adults in the United States. Archives of Ophthalmology (Chicago, Ill.: 1960), 122(4), 477-485. https://doi.org/10.1001/ archopht.122.4.477
[5]. Dhamale, S., Waghmare, P., Gaikwad, T., Yadav., K., & Ghadling, S. (2015). A recent study on object recognition for visually impaired persons using smart phone. International Journal of Advance Research in Computer Science and Management Studies, 3(2), 61–65.
[6]. Emerging Technology. (2018). The secret world of disabled gamers. MIT Technology Review. https://www. technologyreview.com/s/611375/the-secret-world-ofdisabled- gamers
[7]. Hagargund, A. G., Shaik, E. F., Beru, M., & Thota, S. V. (2017). Image to speech conversion for visually impaired. International Journal of Latest Research Engineering and Technology (IJLRET), 3, 09-15.
[8]. Jaymalin, M. (2017). Over 2 Million Pinoys Blind, Sight- Impaired. Philstar Global Newspaper. Retrieved from https://www.philstar.com/headlines/2017/08/06/1726085/ over-2-million-pinoys-blind-sight-impaired
[9]. Mandal., A. (2018). Types of visual impairment. News Medical Life Sciences. https://www.news-medical.net/ health/Types-of-visual-impairment.aspx
[10]. Marston, J. R., & Golledge, R. G. (2003). The hidden demand for participation in activities and travel by persons who are visually impaired. Journal of Visual Impairment & Blindness, 97(8), 475-488. https://doi.org/10.1177/ 0145482X0309700803
[11]. Metz., R. (2016). App spots objects for visually impaired. MIT Technology Review. Retrieved from https:// www.technologyreview.com/2016/03/25/161406/appspots- objects-for-the-visually-impaired/
[12]. Patel, C., Patel, A., & Patel, D. (2012). Optical character recognition by open source OCR tool tesseract: A case study. International Journal of Computer Applications, 55(10), 50-56.
[13]. Patil, M., & Kagalkar, R. (2015). An Automatic Approach for Translating Simple Images into Text Descriptions and Speech for Visually Impaired People. International Journal of Computer Applications, 118(3), 14-19.
[14]. Prakash, M. K. D. J., Harish, P., & Deepika, M. K. (2015, March). Android based object recognition into voice input to aid visually impaired. In International Conference on Recent Trends In Engineering Science And Management (pp. 4078-4153). https://doi.org/10.1177/0145482X03 09700803
[15]. Dutoit, T. (1997). High-quality text-to-speech synthesis: An overview. Journal Of Electrical And Electronics Engineering Australia, 17, 25-36. Retrieved from https://www.semantic scholar.org/paper/High-quality-text-to-speech-synthesis- %3A-an-overview-Dutoit
[16]. World Health Organization. (2019). Blindness and vision impairment. Retrieved from https://www.who.int/ news-room/fact-sheets/detail/blindness-and-visual-impairment
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.