i-manager Publications

A Study for Improving the Reliability and Ethicality of Offline Assessment

Mustafa Erdemir *, Halil Ibrahim Akyuz **

* Department of Mathematics and Science Education, Kastamonu University, Turkey.

** Department of Computer and Instructional Technologies Education, Kastamonu University, Turkey.

Periodicity:June - August'2020
DOI : https://doi.org/10.26634/jsch.16.1.17339

Abstract

The purpose of this study is to reduce ethics violations such as tricking and cheating that may occur in the offline assessment of undergraduate level Physics-II (Electricity) course subjects. The study is significant for the reliable and ethical evaluation of the Internet and computer-based educational process. Thirty-eight pre-service teachers participated in the study by using the Internet and computer. The offline assessment exam consisted of 18 conceptual and operational (problems) questions concerning the subjects covered in the Physics-II course, and the exam duration was 60 minutes. Ethics violations in the exam were determined by analyzing the exam results based on five criteria: time passed in the exam, the number of right and wrong answers, the distribution of right and wrong answers, the distribution of unanswered questions, offline exam mark, and in-class academic success score. Based on these criteria, 23 pre-service teachers were seen to have violated ethics, while 15 pre-service teachers did not engage in such violations. This can be used as a criterion for maintaining the reliability and ethicality of offline Physics-II exams conducted over the Internet. Besides the application of such criteria, question pools containing a great number of questions and various exams with high reliability that are made up of these questions may be created, and the constraints of the Internet and computer-based exams may be decreased, thereby rendering them more reliable.

Keywords

Internet and Computer-Based Education, Physics Education, Offline Assessment, Reliability, Ethics.

How to Cite this Article?

Erdemir, M., and Akyuz, H. I. (2020). A Study for Improving the Reliability and Ethicality of Offline Assessment. i-manager's Journal on School Educational Technology, 16(1), 1-10. https://doi.org/10.26634/jsch.16.1.17339

References

[1]. Aisbitt, S., & Sangster, A. (2005). Using internet-based on-line assessment: A case study. Accounting Education: An International Journal, 14(4), 383-394. https://doi.org/10. 1080/06939280500346011

[2]. Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34- 37.

[3]. Arkorful, V. & Abaidoo, N. (2014). The role of e-learning, advantages, and disadvantages of its adoption in higher education. International Journal of Education and Research, 2(12), 397–410. https://ijern.com/journal/2014/ December-2014/34.pdf

[4]. Balta, Y. & Türel, Y. K. (2013). Çevrimiçi uzaktan eğitimde kullanılan farklı ölçme değerlendirme yaklaşımlarına ilişkin bir inceleme. Turkish Studies, 8(3), 37-45. http://www.acarin dex.com/dosyalar/makale/acarindex-1423933010.pdf

[5]. Bawarith, R., Basuhail, A., Fattouh, A., & Gamalel-Din, S. (2017). E-exam cheating detection system. (IJACSA) International Journal of Advanced Computer Science and Applications. 8(4),176–181.

[6]. Biggs, J. & Tang, C. (2007). Teaching for Quality Learning at University (3^rd ed.). Berkshire: Open University Press.

[7]. Cabi, E. (2016). Uzaktan Eğitimde E-Değerlendirme Üzerine Öğrenci Algıları. Yükseköğretim ve Bilim Dergisi. 6(1), 94-101. https://doi.org/10.5961/jhes.2016.146

[8]. Crisp, G. (2007). The e-Assessment Handbook. New York: Continuum International Publishing Group.

[9]. Dommeyer, C. J., Baum, P., Hanna, R. W., & Chapman, K. S. (2004). Gathering faculty teaching evaluations by inclass and online surveys: Their effects on response rates and evaluations. Assessment & Evaluation in Higher Education, 29(5), 611–623. https://doi.org/10.1080/0260 2930410001689171

[10]. Fagbola, T. M., Adigun, A. A., & Oke, A. O. (2013). Computer-Based test (Cbt) system for university academic enterprise examination. International Journal of Scientific & Technology Research, 2(8), 336-342.

[11]. Gibbs, G., & Simpson, C. (2005). Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education, (1), 3-31. http://eprints. glos.ac.uk/3609/

[12]. Hartshorne. R, & Ajjan, H. (2009). Examining student decision to adopt web 2.0 technologies: Theory and empirical tests. Journal of computing in higher education, 21(3), 183-198. https://doi.org/10.1007/s12528-009-9023-6

[13]. Lewis, D. J. A. & Sewell, R. D. (2007). Providing formative feedback from a summative computer aided assessment. American Journal of Pharmaceutical Education, 71(2), 33.

[14]. Llamas-Nistal, M., Fernández-Iglesias, M. J., González-Tato, J. & Mikic-Fonte, F. A. (2013). Blended eassessment: Migrating classical exams to the digital world. Computers & Education, 62(1), 72-87 https://doi.org/10. 1016/j.compedu.2012.10.021

[15]. Nicol, D. (2007). Principles of good assessment and feedback: Theory and practice. In REAP International Online Conference on Assessment Design for Learner Responsibility (pp. 29-31).

[16]. Questionmark, (2020). Five steps to better tests: Free White Paper. https://support.questionmark.com/content/5- steps-better-tests-free-white-paper

[17]. Ridgway, J., McCusker, S., & Pead, D. (2004). Literature review of e-assessment. https://telearn.archivesouvertes. fr/hal-00190440/

[18]. Rossi. P. G. (2009). Learning environment with artificial intelligence elements. Journal of e-learning and Knowledge Society, 5(1), 191-199. http://www.je-lks.org/ ojs/index.php/Je-LKS_EN/article/view/306/120

[19]. Rytkönen, A. & Myyry, L. (2014). Student experiences on taking electronic exams at the University of Helsinki. In J. Viteli & M. Leikomaa (Eds.), Proceedings of EdMedia 2014- World Conference on Educational Media and Technology (pp. 2114-2121). Tampere, Finland: Association for the Advancement of Computing in Education (AACE). https:// www.learntechlib.org/primary/p/147766/

[20]. Shuey, S. (2002). Assessing Online Learning in Higher Education. Journal of Instruction Delivery Systems, 16(2),13- 18.

[21]. Smedley, J.K. (2010). Modelling the impact of knowledge management using technology. OR Insight, 23(4), 233–250. https://doi.org/10.1057/ori.2010.11

[22]. Osuji, U.S.A. (2012). The use of e-assessments in the Nigerian higher education system. Turkish Online Journal Distance Education, 13(4), 140–152.

[23]. Whitelock, D. M.,& Brasher, A. (2006). Developing a Roadmap for e-Assessment: Which WayNow? In: Danson, th Myles (Ed.) Proceedings of the 10 CAA International Computer Assisted Assessment Conference. Lough borough, UK: Professional Development, Loughborough University, 487–501. https://oro.open.ac.uk/11950/1/CA A_Conf_06_roadmap_paperfv .pdf

[24]. Williams, J. B., & Wong, A. (2009). The efficacy of final examinations: A comparative study of closed-book, invigilated exams and open-book, open-web exams. British Journal of Educational Technology, 40(2), 227-236. https://doi.org/10.1111/j.1467-8535.2008.00929.x

[25]. Young, J. R. (1997). Rethinking the Role of the Professor in an Age of High-Tech Tools. Chronicle of Higher Education, 44(6), A26-A28. https://eric.ed.gov/?id=EJ55 2453

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.