Measurement and Evaluation Challenges in Distance Education: Systematic Review and Qualitative Meta-Synthesis

N. Bilge Uzun*, Mehtap Aktaş**, Cenk Akay***
*-*** Mersin University, Turkey.
** Trakya University, Turkey.
Periodicity:January - March'2023
DOI : https://doi.org/10.26634/jet.19.4.19368

Abstract

The challenges experienced in measurement and evaluation during the distance education process among student and instructor groups are discussed in the study. A qualitative meta-synthesis method is used in this research. Twenty studies were included in the meta-synthesis. The challenges experienced by the instructors are program utilization, technological inadequacies, a lack of in-service seminars, online exam diversity, inconsistency between what is measured and what is intended to be measured, interference of other features with the measurement, unsuitability of the measurement tools, academic dishonesty, lack of control over online exam diversity, preparation and grading challenges, infrastructural issues, and a lack or latency of feedback. Challenges experienced by learners include alienation to the electronic environment, language, technological inadequacies, lack of materials, validity-reliability issues, application difficulty, lack of guidance in exams, infrastructural issues, network problems, lack of interest and motivation, anxiety about online exams, and avoidance and resistance to self-disclosure in virtual environments.

Keywords

Measurement and Evaluation, Distance Education, Challenges, Meta-Synthesis, Systematic Review.

How to Cite this Article?

Uzun, N. B., Aktaş, M., and Akay, C. (2023). Measurement and Evaluation Challenges in Distance Education: Systematic Review and Qualitative Meta-Synthesis. i-manager’s Journal of Educational Technology, 19(4), 1-23. https://doi.org/10.26634/jet.19.4.19368

References

[1]. Allen, I. E., & Seaman, J. (2008). Staying the Course: Online Education in the United States, 2008. Sloan Consortium.
[2]. Badu-Nyarko, S. K., & Amponsah, S. (2017). Assessment of challenges in distance education at University of Ghana. Indian Journal of Open Learning, 25(2), 87-103.
[6]. Cabı, E. (2016). Uzaktan eğitimde e-değerlendirme üzerine öğrenci algıları. Yükseköğretim ve Bilim Dergisi, (1), 94-101.
[11]. Clariana, R. B. (1993). A review of multiple-try feedback in traditional and computer-based instruction. Journal of Computer-Based Instruction, 20(3), 67-74.
[12]. Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Holt, Rinehart and Winston.
[14]. Dietel, R. J., Herman, J. L., & Knuth, R. A. (1991). What does research say about assessment. North Central Regional Educational Laboratory, 1, 18.
[16]. Fei, W. F., Abd Aziz, M. S., Azman, H., & Razak, N. (2005). An online assessment of language proficiency: development and challenges. Internet Journal of e-Language Learning & Teaching, 2(1), 13-24.
[17]. Finfgeld-Connett, D. (2018). A Guide to Qualitative Meta-Synthesis. Routledge.
[19]. Gikandi, J. W. (2012). Online Formative Assessment in Higher Education: Enhancing Continuing Teacher Education in E-Learning (Doctoral Dissertation, University of Canterbury).
[21]. Guilford, J. P., & Fruchter, B. (1973). Fundamental Statistics in Psychology and Education. McGraw-Hill.
[23]. Hannafin, M., Hill, J. R., Oliver, K., Glazer, E., & Sharma, P. (2003). Cognitive and learning factors in webbased distance learning environments. Handbook of Distance Education, 245-260.
[26]. Hillier, M. (2014, January). The very idea of e-Exams: student (pre) conceptions. In Proceedings of ASCILITE 2014-Annual Conference of the Australian Society for Computers in Tertiary Education (pp. 77-88).
[30]. Karal, H., Çebi, A., Pekşen, M., Turgut, Y. E., & Merkezi, U. E. (2010). Sözel problemlerin anlamlandırılması ve çözümünde web tabanlı eğitsel simülasyonların etkisi. University of Gaziantep Journal of Social Sciences, 9(1), 147-162.
[31]. Kaya, Z. (2002). Uzaktan Eğitim. Pegem A Yayıncılık.
[32]. Kearns, L. R. (2012). Student assessment in online learning: Challenges and effective practices. Journal of Online Learning and Teaching, 8(3), 198-208.
[33]. King, C. G., Guyette Jr, R. W., & Piotrowski, C. (2009). Online exams and cheating: An empirical analysis of business students' views. Journal of Educators Online, 6(1), 1-11.
[35]. Kürtüncü, M., & Aylin, K. (2020). COVID-19 pandemisi döneminde hemşirelik öğrencilerinin uzaktan eğitim konusunda yaşadiklari sorunlar. Avrasya Sosyal ve Ekonomi Araştırmaları Dergisi, 7(5), 66-77.
[37]. Livingston, S. A. (1988). Reliability of Test Results. J. P. Keeves (ed.) Educational Research, Methodology and Measurement: An International Handbook (pp. 386-392). Pergamon Press, Oxford, England.
[38]. Lord, F. M., Novick, M. R., & Birnbaum, A. (1968). Statistical Theories of Mental Test Scores. Addison-Wesley.
[39]. Magnusson, D. (1967). Test Theory. Addison-Wesley.
[41]. Moore, M. G., & Kearsley, G. (2011). Distance Education: A Systems View of Online Learning. Cengage Learning.
[42]. Nyika, R. (2016). Use of E-Formative assessment in open [9] and Distance Learning (ODL): Possibilities and challenges of open and distance university tutors in Zimbabwe. International Journal of Advanced Research in Education & Technology, 3(4), 127-131.
[43]. Ogange, B. O., Agak, J. O., Okelo, K. O., & Kiprotich, P. (2018). Student perceptions of the effectiveness of formative assessment in an online learning environment. Open Praxis, 10(1), 29-39.
[44]. Ozer, B., & Ustun, E. (2020). Evaluation of students' views on the covid-19 distance education process in music departments of fine arts faculties. Asian Journal of Education and Training, 6(3), 556-568.
[45]. Pace, D. S. (2020). The use of Formative Assessment (FA) in Online Teaching and Learning during the COVID-19 compulsory education school closure: the Maltese experience. Malta Review of Educational Research, 14(2), 243-271.
[47]. Ramu, T., & Arivoli, T. (2013). A framework of secure biometric based online exam authentication: an alternative to traditional exam. International Journal of Scientific & Engineering Research, 4(11), 52-60.
[48]. Rofiqo, K. (2019). Students' challenges in working on online assessment using blog in Computer Assissted Language Learning (CALL) Class: A case study at English Language Education Department in UIN Sunan Ampel Surabaya (Doctoral dissertation, Uin Sunan Ampel Surabaya).
[52]. Sandelowski, M., & Barroso, J. (2007). Handbook for Synthesizing Qualitative Research. Springer publishing company.
[54]. Simon, W. E. (2019). Evaluation of Online Formative Assessment Practices at Higher Education Institutions (Doctoral dissertation, University of Pretoria).
[55]. Simonso, M., Smaldino, S., Albright, M., & Zvacek, S. (2003). Teaching and Learning at a Distance. Ohio Columbus.
[58]. Turgut, M. F., & Baykul, Y. (2019). Eğitimde Ölçme ve Değerlendirme Metotları. Pegem Akademi.
[61]. Uşun, S. (2006). Uzaktan Eğitim. Nobel Yayınları.
[62]. Van Vollenhoven, W. J., & Combrinck, M. (2020). Computer-assisted assessment: an old remedy for challenges in open distance learning. The Independent Journal of Teaching and Learning, 15(1), 22-34.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Pdf 35 35 200 20
Online 35 35 200 15
Pdf & Online 35 35 400 25

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.