A Model for Determining Teaching Efficacy Through the Use of Qualitative Single Subject Design, Student Learning Outcomes and Associative Statistics

James Edward Osler II*, Mahmud A. Mansaray**
*-** North Carolina Central University.
Periodicity:June - August'2014
DOI : https://doi.org/10.26634/jsch.10.1.2831

Abstract

Many universities and colleges are increasingly concerned about enhancing the comprehension and knowledge of their students, particularly in the classroom. One of the method to enhancing student success is teaching effectiveness. The objective of this research paper is to propose a novel research model which examines the relationship between teaching effectiveness and student learning outcomes qualitatively. This new model will use a unique and in–depth qualitative case study methodology especially designed for the instructional setting. The anticipated qualitative data collecting techniques will include, but not limited to the following: observations, personal interviews, qualitative survey questionnaires, research field notes, document review, etc. The proposed Model used assumed data and applied statistical Cross–Tabulation and Chi–Square Tests, including a theoretical analysis of the open–ended responses and field notes recorded from participants (a sample of 32 students presently enrolled in a Semester–long English ENG 1200–01 course at a public university in North Carolina). The associative statistical findings found a positive relationship between the teaching effectiveness and student learning. The outcomes of the study will increase the current lack of information on the use of qualitative research designs by determining teaching efficacy and its effects on student achievement. This new model expands the existing measures by providing new measures to examine the teaching effectiveness and its effect on student learning.

Keywords

Case Study Design, Student Ratings of Instruction, Validity, Reliability, Cross–Tabulation, Chi–Square, Field Notes, Qualitative Data Analysis Software.

How to Cite this Article?

Osler,J.E., & Manasaray,M (2014). A Model For Determining Teaching Efficacy Through The Use Of Qualitative Single Subject Design, Student Learning Outcomes And Associative Statistics.i-manager’s Journal on School Educational Technology, 10(1), 22-35. https://doi.org/10.26634/jsch.10.1.2831

References

[1]. Abel, E., & Campbell, M. (2009). Student–centered learning in an advanced social work practice course: Outcomes of a mixed methods investigation. Social Work Education,28(1),3–17. doi:10.1080/02615470701844423.
[2]. Agbetsiafa, D. (2010). Evaluating effective teaching in college level Economics using student ratings of instruction: A factor analytic approach. Journal of College Teaching & Learning, 7(5), 57–66. Retrieved from http://journals.cluteonline.com/index.php/TLC.
[3]. Bakar, K., Safavi, S., Tarmizi, R., & Alwi, N. (2011). Student ratings of instruction from perspective of higher education administrators. Journal of Academic Administration in Higher Education, 7(2), 61. Retrieved from http://jwpress.com/ JAAHE/JAAHE.htm.
[4]. Barclay, L., Herlich, S. A., & Sacks, S. (2010). Effective teaching strategies: Case studies from the alphabetic braille and contracted braille study. Journal of Visual Impairment and Blindness, 104(12), 753–764. Retrieved from http://www.afb.org/jvib/jvib_main.asp.
[5]. Beran, T., & Rokosh, J. (2009). Instructors' perspectives on the utility of student ratings of instruction. Instructional Science,37(2),171–184.doi:10.1007/s 11251–007–9045–2.
[6]. Bouta, H., Retalis, S., & Paraskeva, F. (2012). Utilising a collaborative macro–script to enhance student engagement: A mixed method study in a 3D virtual environment. Computers & Education, 58(1), 501–517. doi:10.1016/j.compedu.2011.08.031.
[7]. Campbell, A., McCall, S., Eagleson, H., & McGinnis, E.(2012). An evaluation of the effectiveness of an FE/HE partnership in the delivery of a preparation for practice module within an undergraduate social work degree programme. Social Work Education, 31(5), 6 6 3 – 6 7 7 . doi:10.1080/02615479.2011.584181.
[8]. Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). Thousand Oaks, CA: Sage.
[9]. Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn?. Journal of Marketing Education, 31(1), 16–30. Retrieved from http://jmd.sagepub.com/.
[10]. Davidson, B., Worrall, L., & Hickson, L. (2008). Exploring the interactional dimension of social communication: A collective case study of older people with aphasia. Aphasiology,22(3),235– 257.doi:10.1080/02687030701268024
[11]. Dodeen, H. (2013). College students' evaluation of effective teaching: Developing an instrument and assessing its psychometric properties. Research in Higher Education Journal, 21, 1–12. Retrieved from http://aabri.com.
[12]. Donnon, T., Delver, H., & Beran, T. (2010). Student and teaching characteristics related to ratings of instruction in medical sciences graduate programs. Medical Teacher, 32(4), 327–332. doi:10.3109/01421590903480097.
[13]. du Plessis, A., & Webb, P. (2012). Teachers' perceptions about their own and their schools' readiness for computer implementation: A South African case study. Turkish Online Journal of Educational Technology, 11(3), 312–325. Retrieved from http://www.tojet.net/.
[14]. El Hassan, K. (2009). Investigating substantive and consequential validity of student ratings of instruction. Higher Education Research & Development, 28(3), 319–333. doi:10.1080/07294360902839917.
[15]. Flyvbjerg, B. (2006). Five misunderstandings of case study research. Qualitative Inquiry, 12(2), 219–245. Retrieved from http://www.sagepub.com/journals/Journal200797.
[16]. Galbraith, C., Merrill, G., & Kline, D. (2012). Are student evaluations of teaching effectiveness valid for measuring student learning outcomes in business related classes? A neural network and bayesian analyses. Research in Higher Education, 53(3), 353–374. doi:10.1007/s11162–011–9229–0.
[17]. Galbraith, J. M. (2012). Using student competition field trips to increase teaching and learning effectiveness. Journal of Natural Resources and Life Sciences Education, 41(1), 54–58. Retrieved from http://search.proquest.com. proxy1.ncu.edu/docview/1008665103?accountid=2818 0.
[18]. Goorha, P., & Mohan, V. (2010). Understanding learning preferences in the business school curriculum. Journal of Education for Business, 85(3), 145–152. doi:10.1080/08832320903252363.
[19]. Gravestock, P., &Gregor–Greenleaf, E. (2008). Student course evaluations: Research, models and trends. Toronto, ON: Higher Education Quality Council of Ontario. Retrieved from http://www.heqco.ca/SiteCollection Documents/Student%20Course%20Evaluations.pdf.
[20]. Haladyna, T. M., &Amrein–Beardsley, A. (2009). Validation of a research–based student survey of instruction in a college of education. Educational Assessment, Evaluation and Accountability, 21(3), 255–276. doi:10.1007/s11092–008–9065–8.
[21]. Hunsaker, S. L., Nielsen, A., & Bartlett, B. (2010). Correlates of teacher practices influencing student outcomes in reading instruction for advanced readers. Gifted Child Quarterly,54(4),273–282. Doi:10.1177/0016986210374506.
[22]. James, A. R., Griffin, L., & Dodds, P. (2009). Perceptions of middle school assessment: an ecological view. Physical Education & Sport Pedagogy, 14(3), 323–334. doi:10.1080/17408980802225792.
[23]. Keeley, J., Furr, R., & Buskist, W. (2010). Differentiating psychology students' perceptions of teachers using the teacher behavior checklist. Teaching of Psychology, 37(1), 16–20. doi:10.1080/00986280903426282.
[24]. Kozub, R. M. (2010). Relationship of course, instructor, and student characteristics to dimensions of student ratings of teaching effectiveness in business schools. American Journal of Business Education, 3(1), 33–40. Retrieved from http://journals.cluteonline.com/index.php/AJBE.
[25]. Laragy, C., & Ottmann, G. (2011). Towards a framework for implementing individual funding based on an Australian case study. Journal of Policy and Practice in Intellectual Disabilities, 8(1), 18–27. doi:10.1111/j. 1741–1130.2011.00283.x.
[26]. Maclellan, E. (2008). The significance of motivation in student–centred learning: A reflective case study. Teaching in Higher Education, 13(4), 411–421. doi:10.1080/13562510802169681.
[27]. Madden, T. J., Dillon, W. R., & Leak, R. L. (2010). Students' evaluation of teaching: Concerns of item diagnosticity. Journal of Marketing Education, 32(3), 264–274. doi:10.1177/0273475310377759.
[28]. Marsh, H. W. (2007). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and usefulness. In R. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence–based perspective(pp.319–383).Netherlands: Springer.
[29]. Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?. Journal of Educational Psychology, 92(1), 202–228. doi:10.1037/0022–0663.92.1.202.
[30]. Martinez, G., Perez, A., Suero, M., & Pardo, P. J. (2013). The effectiveness of concept maps in teaching physics concepts applied to engineering education: Experimental comparison of the amount of learning achieved with and without concept maps. Journal of Science Education and Technology,22(2),204–214. Retrieved from http://www.springer.com/education+%26+language/sci ence+education/journal/10956.
[31]. Mason, J. (2002). Qualitative researching(2nd ed.). Thousand Oaks, CA: Sage
[32]. McKeachie, W. J. (1979). Student ratings of faculty: A reprise. Academe, 65, 384–397. Retrieved from http://www.aaup.org/reports–and–publications/academe.
[33]. McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52(11), 1218–1225. doi:10.1037/0003–066X.52.11.1218
[34]. McKeachie, W. J. (2007). Good teaching makes a difference—And we know what it is. In R. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence–based perspective (pp. 457–474). Netherlands: Springer.
[35]. Miles, M. B. (1979). Qualitative data as an attractive nuisance: The problem of analysis. Administrative Science Quarterly,24(4),590– 601 Retrieved from http://asq.sagepub.com/.
[36]. Nurani M. L. (2008). Critical review of ethnographic approach. Jurnal Sosioteknologi Edisi. Retrieved from http://journal.fsrd.itb.ac.id/jurnal–desain/.
[37]. Padgett, D. K. (2003). The qualitative research experience (1st ed.). Belmont, CA: Brooks/Cole Cengage Learning.
[38]. Pounder, J. (2007). Is student evaluation of teaching worthwhile? An analytical framework for answering the question. Quality Assurance in Education, 18(1), 47–63. Retrieved from http://www.emeraldinsight.com/ journals.htm?issn=0968–4883.
[39]. Ritchie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In A.
[40]. Bryman & R. G. Burgess (Eds.), Analysing qualitative data (Vol. 2, pp. 173–194). London, England: Routledge.
[41]. Safavi, S., Bakar, K., Tarmizi, R., & Alwi, N. (2012). The role of student ratings of instruction from perspectives of the higher education administrators. International Journal of Business and Social Science, 3(9), 233–239. Retrieved from http://www.ijbssnet.com/.
[42]. Scandura, T. A., & Williams, E. A. (2000). Research methodology in management: Current practice, trends, and implications for future research. Academy of Management Journal, 43(6), 1248–1264. Retrieved from http://aom.org/amj/.
[43]. Schrodt, P., Witt, P. L., Myers, S. A., Turman, P. D., Barton, M. H., & Jernberg, K. A. (2008). Communication Education,57(2),180–200.doi:10.1080/03634520701840303.
[44]. Skowronek, J., Friesen, B., & Masonjones, H. (2011). Developing a statistically valid and practically useful student evaluation instrument. International Journal for the Scholarship of Teaching and Learning, 5(1), 1–19. Retrieved from http://digitalcommons.georgiasouthern. edu/ij–sotl/.
[45]. Smart, K. L., Witt, C., & Scott, J. P. (2012). Toward learner–centered teaching: An inductive approach. Business Communication Quarterly, 75(4), 392–403. doi:10.1177/1080569912459752.
[46]. Sprinkle, J.E. (2008). Student perceptions of effectiveness: An examination of the influence of student biases. College Student Journal, 42(2), 276–293. Retrieved from http://www.projectinnovation.com/College_Student_Journal.html.
[47]. Stehle, S., Spinath, B., & Kadmon, M. (2012). Measuring teaching effectiveness:Correspondence between students' evaluations of teaching and different measures of student learning. Research in Higher Education, 53(8), 888–904. doi:10.1007/s11162–012–9260–9.
[48]. Stowell, J. R., Addison, W. E., & Smith, J. L. (2012). Comparison of online and classroom– Based student evaluations of instruction. Assessment & Evaluation in Higher Education,37(4),465–473 . doi:10.1080/02602938.2010.545869.
[49]. Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Thousand Oak, CA: Sage.
[50]. Svinivki, M., & Mckeachie, W. J. (2010). McKeachie's teaching tips: Strategies, research and theory for college and university teachers. Boston, MA: Houghton Mifflin.
[51]. Taras, V., Caprar, D. V., Rottig, D., Sarala, R. M., Zakaria, N., Zhao, F., &. Zengyu Haung, V. (2013). A global classroom? Evaluating the effectiveness of global virtual collaboration as a teaching tool in management education. Academy of Management Learning and Education, 12(3), 414–435. doi:10.5465/amle.2012.0195.
[52]. Titus, J. (2008). Student ratings in a consumerist academy: Leveraging pedagogical control and authority. Sociological Perspective, 51, 397–422. Retrieved from http://www.sagepub.com/journals/Journal202165.
[53]. Webb, L., De Lange, P., & O'Connell, B. (2009). A programme to expose students to senior executives in the world of accounting: An innovative learning method. Accounting Education,18(2), 183–205.doi: 10.1080/09639280802436723.
[54]. Wright, S., & Grenier, M. (2009). Examining effective teaching via a social constructive pedagogy "Case Study". Education,130(2),255– 264. Retrieved from http://www.projectinnovation.com/Education.html.
[55]. Yin, R. K. (1981). The case study crisis: Some answers. Administrative Science Quarterly, 26(1), 58–65. Retrieved from http://asq.sagepub.com/.
[56]. Yin, R. (2013). Case study research: Design and methods (5th ed.). Thousand Oaks, CA: Sage.
[57]. Yu, Z., Zhiming, C., & Harvie, C. (2013). The roles of size and size difference in Australian and Chinese inter–firm collaborations. Australasian Accounting Business and Finance Journal, 7(2), 33–48. Retrieved from http://ro.uow.edu.au/aabfj/.
[58]. Zhao, J., & Gallant, D. J. (2012). Student evaluation of instruction in higher education: exploring issues of validity and reliability. Assessment & Evaluation In Higher Education, 37(2), 227–235. doi:10.1080/02602938. 2010.523819.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Online 15 15

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.