Chatbot Usability Scale: Adaptation to Turkish and Validation/Reliability Analysis

Mehmet Yavuz*, Bünyami Kayali**, Şener Balat***, Mücahit Çalişan****
* Bingöl University's Distance Education and Research Center, Turkey.
** Department of Computer Technologies, Bayburt University, Merkez, Turkey.
***,**** Bingöl University, Turkey.
Periodicity:April - June'2023


The aim of this study is to adapt the 15-item Chatbot Usability Scale to the Turkish language and culture and evaluate the validity and reliability of the scale in the Turkish language and culture after the adaptation process. The necessary permissions were obtained, and the process was initiated. Proficient translators in both cultures were selected to ensure linguistic equivalence, and they carried out the translation process proficiently in both languages. The scale was translated back to its original language to enhance its suitability, and linguistic equivalence was ensured. The sample for the study included 406 students from eight different undergraduate and associate degree programs at a state university. Following the item analysis, the Cronbach's Alpha coefficient of the scale was found to be 0.935. Exploratory and confirmatory factor analyses were applied and it was found that the scale had a two-factor structure for Turkish university students. As a result of this study, the Chatbot Usability Scale has been adapted to the Turkish language and culture. As a suggestion, the generalizability of the scale can be increased by applying it to individuals from different age groups, genders, educational levels, and occupational groups and evaluating the test-retest reliability of the scale in future studies.


Chatbot, Usability Scale, Artificial Intelligence, Turkish Adaptation, Validation Analysis, Reliability Analysis, Turkish Language.

How to Cite this Article?

Yavuz, M., Kayali, B., Balat, Ş., and Çalişan, M. (2023). Chatbot Usability Scale: Adaptation to Turkish and Validation/Reliability Analysis. i-manager’s Journal of Educational Technology, 20(1), 11-19.


[2]. Balaji, D. (2019). Assessing user Satisfaction with İn formation Chatbots: A Preliminary İnvestigation (Master's thesis, University of Twente).
[7]. Büyüköztürk, Ş. (2007). Data Analysis Handbook. Pegem Akademi Yayıncılık, Ankara, Turkey (pp. 167-182).
[8]. Büyüköztürk, Ş. (2011). Data Analysis Handbook for Social Sciences. Pegem Akademi, Ankara.
[10]. Field, A. (2019). Discovering Statistics using IBM SPSS Statistics. SAGE Publications, India.
[12]. Gliem, J. A., & Gliem, R. R. (2003). Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. Midwest Research-toPractice Conference in Adult, Continuing, and Community Education (pp. 82-88).
[13]. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis. Pearson.
[16]. Hiremath, G., Hajare, A., Bhosale, P., Nanaware, R., & Wagh, K. S. (2018). Chatbot for education system. International Journal of Advance Research, Ideas and Innovations in Technology, 4(3), 37-43.
[18]. Juhnke, C., & Muehlbacher, A. C. (2013). Patientcentredness in integrated healthcare delivery systemsneeds, expectations and priorities for organised healthcare systems. International Journal of İntegrated Care, 13.
[19]. Kane, D. A. (2016). The role of chatbots in teaching and learning. E-Learning and the Academic Library: Essays on İnnovative İnitiatives (pp. 131-156).
[20]. Kilic, S. (2016). Cronbach's alpha reliability coefficient. Psychiatry and Behavioral Sciences, 6(1), 47-48.
[21]. Kline, R. B. (2005). Principles and Practice of Structural Equation Modeling. Guilford publications.
[22]. Lin, M. P., & Chang, D. (2020). Enhancing postsecondary writers' writing skills with a chatbot: A mixedmethod classroom study. Journal of Educational Technology & Society, 23(1), 78-92.
[23]. Nilsson, J. (2018). Artificial İntelligence: A History And Future. Boğaziçi University Press, Istanbul.
[24]. Özdamar, K. (2004). Construction of tables, reliability and analysis of questions. Statistical Data Analysis With Package Programs-1.
[25]. Özgüven, İ. E. (1994). Psychological Tests. Yeni Doğuş Matbaası, Ankara.
[26]. Ren, R., Castro, J. W., Acuña, S. T., & de Lara, J. (2019). Usability of chatbots: A systematic mapping study. In A. Perkusich (Ed.), Proceedings of the 31st International Conference on Software Engineering and Knowledge Engineering, SEKE 2019 (pp. 479-617).
[27]. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23-74.
[30]. Sumer, N. (2000). Structural equation models: Basic concepts and sample applications. Turkish Psychology Articles, 3(6), 49-74.
[31]. Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2013). Using Multivariate Statistics. Pearson, Boston (pp.497-516).
[35]. Weichbroth, P. (2018, September). Usability attributes revisited: a time-framed knowledge map. In 2018 Federated Conference on Computer Science and Information Systems (FedCSIS) (pp. 1005-1008). IEEE.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.