i-manager Publications

A Survey of Research Trends on University Websites' Usability Evaluation

Solomon A. Adepoju*, Ishaq O. Oyefolahan**, Muhammad B. Abdullahi***, Adamu A. Mohammed****

*,*** Department of Computer Science, Federal University of Technology, Minna, Nigeria.

** Department of Information and Media Technology, Federal University of Technology, Minna, Nigeria.

**** Department of Mathematics and Applied Science, Federal University of Technology, Minna, Nigeria.

Periodicity:March - May'2019
DOI : https://doi.org/10.26634/jit.8.2.15714

Abstract

Research on website usability evaluation have been growing in recent times as a result of increased internet penetration rate globally. In view of this, several efforts have been made to develop usability evaluation methods for different genre of websites. Due to its uniqueness, university websites which is a class of academic websites require further attention. This paper hence provides a brief survey of various usability evaluation methods used in university websites and with special focus on Multi Criteria Decision Making (MCDM) approaches. A total of thirty five scholarly articles were retrieved from online database from year 2000 to 2018. The review was classified based on usability evaluation methods, MCDM approaches, and automated tools. Results from the trend analysis shows that automated tools, heuristic evaluation, and user testing methods are the mostly used usability evaluation methods. MCDM approach usage in usability evaluation is also found to be on the increase as well. It is therefore recommended that more attention should be given to the usage of this methodology in the usability evaluation of this important genre of websites.

Keywords

Usability, Websites, Multi Criteria Decision Making, Website Evaluation, University Websites.

How to Cite this Article?

Adepoju, S. A., Oyefolahan, I. O., Abdullahi, M. B., Mohammed, A. A.(2019). A Survey of Research Trends on University Websites' Usability Evaluation, i-manager's Journal on Information Technology, 8(2), 11-19. https://doi.org/10.26634/jit.8.2.15714

References

[1]. Adepoju, S. A., & Shehu, I. S. (2014, September). Usability evaluation of academic websites using automated tools. In User Science and Engineering (i-USEr), 2014 3^rd International Conference on (pp. 186- 191). IEEE.

[2]. Adepoju, S. A., Shehu, I. S., & Bake, P. (2016). Accessibility evaluation and performance analysis of egovernment websites in Nigeria. Journal of Advances in Information Technology, 7(1), 49-53.

[3]. Agarwal, R., & Venkatesh, V. (2002). Assessing a firm's web presence: A heuristic evaluation procedure for the measurement of usability. Information Systems Research, 13(2), 168-186.

[4]. Ahmi, A., & Mohamad, R. (2016). Evaluating accessibility of Malaysian public universities websites using achecker and wave. Journal of ICT, 15(2), 193-214.

[5]. Amaitik, N. M., & El-Sahli, M. J. (2013, January). An evaluation of the usability of IT faculty educational portal at University of Benghazi. In Proceedings of World Academy of Science, Engineering and Technology (No. 78, p. 935). World Academy of Science, Engineering and Technology (WASET).

[6]. Arasid, W., Abdullah, A. G., Wahyudin, D., Abdullah, C. U., Widiaty, I., Zakaria, D., ... & Juhana, A. (2018, February). An Analysis of Website Accessibility in Higher Education in Indonesia Based on WCAG 2.0 Guidelines. In IOP Conference Series: Materials Science and Engineering (Vol. 306, No. 1, p. 012130). IOP Publishing.

[7]. Astani, M., & Elhindi, M. (2008). An empirical study of university websites. Issues in Information Systems, 9(2), 460-465.

[8]. Caglar, E., & Mentes, S. A. (2012). The usability of university websites–a study on European University of Lefke. International Journal of Business Information Systems, 11(1), 22-40.

[9]. Chamba-Eras, L., Jacome-Galarza, L., Guaman- Quinche, R., Coronel-Romero, E., & Labanda-Jaramillo, M. (2017, April). Analysis of usability of universities Web portals using the Prometheus tool-SIRIUS. In e-Democracy & e-Government (ICEDEG), 2017 Fourth International Conference on (pp. 195-199). IEEE.

[10]. Deedam, F. B., Thomas, E. A., & Taylor, O. E. (2018). Accessibility and Usability Evaluation of State-Owned Universities Website in Nigeria. International Journal of Engineering Trends and Technology. 56(1), 31-36.

[11]. Delice, E. K., & Güngör, Z. (2009). The usability analysis with heuristic evaluation and analytic hierarchy process. International Journal of Industrial Ergonomics, 39(6), 934-939.

[12]. Du Toit, M., & Bothma, C. (2009). Evaluating the usability of an academic marketing department's website from a marketing student's perspective. International Retail and Marketing Review, 5(1), 25-37.

[13]. El Rahman, S. A. (2016). Evaluation of Saudi Educational Websites. The International Journal of ELearning and Educational Technologies in the Digital Media (IJEETDM), 2(4), 141-147.

[14]. El-Halees, A. M., & Abu-Zaid, I. M. (2017). Automated Usability Evaluation on University Websites using Data Mining Methods. Automated Usability Evaluation on University Websites using Data Mining Methods, 6(11), 13-21.

[15]. Esmeria, G. J. & Seva, R. R. (2017). Web Usability: A Literature Review. In De La Salle University Research Congress (pp.1-7). Retrieved from: https://pdfs. semanticscholar.org/73fe/783d70e63e80da1aced81a 7c574973b0e1fa.pdf

[16]. González, M. P., Granollers, T., Pascual, A., & Lorés, J. (2008). Testing Website Usability in Spanish-Speaking Academia through Heuristic Evaluation and Cognitive Walkthroughs. J. UCS, 14(9), 1513-1528.

[17]. Grigera, J., Garrido, A., Rivero, J. M., & Rossi, G. (2017). Automatic detection of usability smells in web applications. International Journal of Human-Computer Studies, 97, 129-148.

[18]. Hahn, J., & Kauffman, R. J. (2004). A methodology for business value-driven website evaluation: A data envelopment analysis approach. SIGHCI 2004 Proceedings, (Vol.12).

[19]. Hasan, L. (2013). Heuristic Evaluation of Three Jordanian University Websites. Informatics in Education, 12(2), 231-251.

[20]. Hasan, L. (2014). Evaluating the usability of educational websites based on students' preferences of design characteristics. International Arab Journal of e- Technology, 3(3), 179-193.

[21]. Hasan, L. (2014). The Website of the University of Jordan: Usability Evaluation. International Arab Journal of e-Technology, 3(4), 258-269.

[22]. Hassouna, M. S., & Sahari, N. B. (2014). Palestinians Universities' Website Accessibility: An Initial View. In International Conference on Postgraduate Research.

[23]. Ho, W., Xu, X., & Dey, P. K. (2010). Multi-criteria decision making approaches for supplier evaluation and selection: A literature review. European Journal of Operational Research, 202(1), 16-24.

[24]. International Organization for Standardization. (1998). ISO 9241-11: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)-Pt. 11: Guidance on Usability. ISO.

[25]. Ishizaka, A., & Labib, A. (2011). Review of the main developments in the analytic hierarchy process. Expert Systems with Applications, 38(11), 14336-14345.

[26]. Islam, A., & Tsuji, K. (2011). Evaluation of Usage of University Websites in Bangladesh. DESIDOC Journal of Library & Information Technology, 31(6), 469-479.

[27]. Junaini, S. N. (2002). Navigation design and usability evaluation of the Malaysian public university websites. Navigation, 181, 189.

[28]. Kabak, M., Özceylan, E., Dağdevİren, M., & Genc, T. (2017). Evaluation of distance education websites: A hybrid multicriteria approach. Turkish Journal of Electrical Engineering & Computer Sciences, 25(4), 2809-2819.

[29]. Kabir, G., & Akhtar Hasin, M. A. (2013). Multi-criteria inventory classification through integration of fuzzy analytic hierarchy process and artificial neural network. International Journal of Industrial and Systems Engineering, 14(1), 74-103.

[30]. Karhu, M., Hilera, J. R., Fernández, L., & Ríos, R. (2012). Accessibility and readability of university websites in Finland. Journal of Accessibility and Design for All, 2(2), 178-189.

[31]. Kaur, S., Kaur, K., & Kaur, P. (2016). An empirical performance evaluation of universities website. International Journal of Computer Applications, 146(15), 10-16.

[32]. Kaur, S., Kaur, K., & Kaur, P. (2016, March). Analysis of website usability evaluation methods. In Computing for Sustainable Global Development (INDIACom), 2016 3^rd International Conference on (pp. 1043-1046). IEEE.

[33]. Kostaras, N., & Xenos, M. (2007, May). Assessing educational web-site usability using heuristic evaluation rules. In Proceedings of 11^th Panhellenic Conference in Informatics (pp. 543-550).

[34]. Kubler, S., Robert, J., Derigent, W., Voisin, A., & Le Traon, Y. (2016). A state-of the-art survey & testbed of fuzzy AHP (FAHP) applications. Expert Systems with Applications, 65, 398-422.

[35]. Mentes, S. A., & Turan, A. H. (2012). Assessing the usability of university websites: An empirical study on Namik Kemal University. Turkish Online Journal of Educational Technology-TOJET, 11(3), 61-69.

[36]. Mustafa, S. H., & Al-Zoua'bi, L. F. (2008, December). Usability of the academic websites of Jordan's universities an evaluation study. In Proceedings of the 9^th International Arab Conference for Information Technology (pp. 31-40).

[37]. Nagpal, R., Mehrotra, D., & Bhatia, P. K. (2016). Usability evaluation of website using combined weighted method: Fuzzy AHP and entropy approach. International Journal of System Assurance Engineering and Management, 7(4), 408-417.

[38]. Nagpal, R., Mehrotra, D., & Bhatia, P. K. (2017). The state of art in website usability evaluation methods. In Design Solutions for User-Centric Information Systems (pp. 275-296). IGI Global.

[39]. Nagpal, R., Mehrotra, D., Bhatia, P. K., & Bhatia, A. (2015). FAHP approach to rank educational websites on usability. International Journal of Computing and Digital Systems, 4(04), 251-260.

[40]. Nagpal, R., Mehrotra, D., Bhatia, P. K., & Sharma, A. (2015). Rank university websites using fuzzy AHP and fuzzy TOPSIS approach on usability. International Journal of Information Engineering and Electronic Business, 7(1), 29- 36.

[41]. Nagpal, R., Mehrotra, D., Sharma, A., & Bhatia, P. (2013). ANFIS method for usability assessment of website of an educational institute. World Applied Sciences Journal, 23(11), 1489-1498.

[42]. Nielsen, J. (1999). Designing Web Usability: The Practice of Simplicity. New Riders Publishing.

[43]. Noiwan, J., & Norcio, A. (2000). A comparison analysis on web heuristic usability between Thai academic web sites and US academic web sites. In Proceedings of SGI, World Multi Conference on Systems, Cybermetrics and Informatics (pp. 536-541).

[44]. Peker, S., Kucukozer-Cavdar, S., & Cagiltay, K. (2016). Exploring the relationship between web presence and web usability for universities: A case study from Turkey. Program, 50(2), 157-174.

[45]. Pierce, K. (2005). Website Usability Report for Harvard University. Capella University.

[46]. Roy, S., & Pattnaik, P. K. (2014). A quantitative approach to evaluate usability of academic websites based on human perception. Egyptian Informatics Journal, 15(3), 159-167.

[47]. Roy, S., Pattnaik, P. K., & Mall, R. (2017). Quality assurance of academic websites using usability testing: An experimental study with AHP. International Journal of System Assurance Engineering and Management, 8(1), 1-11.

[48]. Al-Khalifa, H. (2014). A framework for evaluating university mobile websites. Online Information Review, 38(2), 166-185.

[49]. Şengel, E., & Öncü, S. (2010). Conducting preliminary steps to usability testing: investigating the website of Uludağ University. Procedia-Social and Behavioral Sciences, 2(2), 890-894.

[50]. Sun, S., Fong, D. K. C., Law, R., & He, S. (2017). An updated comprehensive review of website evaluation studies in hospitality and tourism. International Journal of Contemporary Hospitality Management, 29(1), 355-373.

[51]. Taha, Z., & Rostam, S. (2011). A fuzzy AHP–ANNbased decision support system for machine tool selection in a flexible manufacturing cell. The International Journal of Advanced Manufacturing Technology, 57(5-8), 719- 733.

[52]. Ugras, T., Gülseçen, S., Çubukçu, C., Erdoğmuş, İ. İ., Gashi, V., & Bedir, M. (2016a, July). Research Trends in Website Usability: A systematic review. In International Conference of Design, User Experience, and Usability (pp. 517-528). Springer, Cham.

[53]. Ugras, T., Gülseçen, S., Çubukçu, C., Erdoğmuş, İ. İ., Gashi, V., & Bedir, M. (2016b, July). Research Trends in Website Usability: A systematic review. In International Conference of Design, User Experience, and Usability (pp. 517-528). Springer, Cham.

[54]. Wanke, P., Azad, M. A. K. Barros, C. P., & Hadi- Vencheh, A. (2016). Predicting performance in ASEAN banks: An integrated fuzzy MCDM–neural network approach. Expert Systems, 33(3), 213-229.

[55]. Yerlikaya, Z., & Durdu, P. O. (2017a, July). Evaluation of Accessibility of University Websites: A Case from Turkey. In International Conference on Human-Computer Interaction (pp. 663-668). Springer, Cham.

[56]. Yerlikaya, Z., & Durdu, P. O. (2017b, July). Usability of University Websites: A systematic review. In International Conference on Universal Access in Human-Computer Interaction (pp. 277-287). Springer, Cham.

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.