An In-Depth Model for Determining Teaching Efficacy through the use of Qualitative Single Subject Design, Student Learning Outcomes, Associative Statistics, and Mixed Methods Post Hoc Data Analysis Methodology

James Edward Osler II*, Mahmud Mansaray**
*-** North Carolina Central University, Durham, North Carolina, United States.
Periodicity:January - June'2020
DOI : https://doi.org/10.26634/jmat.9.1.17400

Abstract

Many universities and colleges in the United States and elsewhere are increasingly concerned about enhancing the comprehension and knowledge of their students, particularly in the classroom. One method of enhancing student success is teaching effectiveness. The overarching objective of this research paper is to propose a novel research model that examines the relationship between teaching effectiveness and student learning outcomes qualitatively and then analyzes the outcomes of the researcher further using a mixed method data analysis methodology. This new model will first use a unique and in–depth qualitative case study methodology especially designed for the instructional setting. The anticipated qualitative initial data collecting techniques will include but not be limited to the following: observations, personal interviews, qualitative survey questionnaires, research field notes, document review, etc. The secondary data analysis model will use the mixed methods (Qualitative and Quantitative) Triostatistics Tri–Squared Test to further validate the research investigation outcomes. The initial data gathering qualitative model uses assumed data and applied statistical Cross–Tabulation and Chi–Square Tests, including a theoretical analysis of the open–ended responses and field notes recorded from participants (a sample of 32 students presently enrolled in a Semester–long English ENG 1200–01 course at a public university in North Carolina). The associative statistical findings found a positive relationship between teaching effectiveness and student learning. The outcomes of this study will increase the current lack of information on the use of qualitative and mixed methods research designs in determining teaching efficacy and its effects on student achievement in the social and behavioral sciences. This new model expands on existing measures by providing new measures to more carefully examine teaching effectiveness and its effect on student learning.

Keywords

Case Study Design, Instructional Equation, Student Ratings of Instruction, Validity, Reliability, Cross–Tabulation, Chi–Square, Field Notes, Qualitative Data Analysis Software, Mixed Methods, Student Learning Outcomes, Tri–Squared Test, and Triostatistics.

How to Cite this Article?

Osler, J. E., II. and Mansaray, M. (2020). An In-Depth Model for Determining Teaching Efficacy through the use of Qualitative Single Subject Design, Student Learning Outcomes, Associative Statistics, and Mixed Methods Post Hoc Data Analysis Methodology. i-manager's Journal on Mathematics, 9(1), 1-17. https://doi.org/10.26634/jmat.9.1.17400

References

[1]. Abel, E., & Campbell, M. (2009). Student–centered learning in an advanced social work practice course: Outcomes of a mixed methods investigation. Social Work Education, 28(1), 3-17. https://doi.org/10.1080/02615470701844423
[2]. Agbetsiafa, D. (2010). Evaluating effective teaching in college level Economics using student ratings of instruction: A factor analytic approach. Journal of College Teaching & Learning, 7(5), 57-66.
[3]. Bakar, K., Safavi, S., Tarmizi, R., & Alwi, N. (2011). Student ratings of instruction from perspective of higher education administrators. Journal of Academic Administration in Higher Education, 7(2), 61-69.
[4]. Barclay, L., Herlich, S. A., & Sacks, S. (2010). Effective teaching strategies: Case studies from the alphabetic braille and contracted braille study. Journal of Visual Impairment and Blindness, 104(12), 753-764.
[5]. Beran, T., & Rokosh, J. (2009). Instructors' perspectives on the utility of student ratings of instruction. Instructional Science, 37(2), 171-184. https://doi.org/10.1007/s11251–007–9045–2
[6]. Bouta, H., Retalis, S., & Paraskeva, F. (2012). Utilising a collaborative macro–script to enhance student engagement: A mixed method study in a 3D virtual environment. Computers & Education, 58(1), 501-517. https://doi.org/10.1016/j.comp edu.2011.08.031
[7]. Campbell, A., McCall, S., Eagleson, H., & McGinnis, E. (2012). An evaluation of the effectiveness of an FE/HE partnership in the delivery of a preparation for practice module within an undergraduate social work degree programme. Social Work Education, 31(5), 663-677. https://doi.org/10.1080/02615479.2011.584181
[8]. Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? Journal of Marketing Education, 31(1), 16-30.
[9]. Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed methods approaches (4 ed.). Thousand Oaks, CA: Sage.
[10]. Davidson, B., Worrall, L., & Hickson, L. (2008). Exploring the interactional dimension of social communication: A collective case study of older people with aphasia. Aphasiology, 22(3), 235–257. https://doi.org/10.1080/026870307012 68024
[11]. Dodeen, H. (2013). College students' evaluation of effective teaching: Developing an instrument and assessing its psychometric properties. Research in Higher Education Journal, 21, 1-12.
[12]. Donnon, T., Delver, H., & Beran, T. (2010). Student and teaching characteristics related to ratings of instruction in medical sciences graduate programs. Medical Teacher, 32(4), 327-332. https://doi.org/10.3109/01421590903480097
[13]. du Plessis, A., & Webb, P. (2012). Teachers' perceptions about their own and their schools' readiness for computer implementation: A South African case study. Turkish Online Journal of Educational Technology, 11(3), 312-325.
[14]. El Hassan, K. (2009). Investigating substantive and consequential validity of student ratings of instruction. Higher Education Research & Development, 28(3), 319-333. https://doi.org/10.1080/07294360902839917
[15]. Flyvbjerg, B. (2006). Five misunderstandings of case study research. Qualitative Inquiry, 12(2), 219-245.
[16]. Galbraith, C., Merrill, G., & Kline, D. (2012). Are student evaluations of teaching effectiveness valid for measuring student learning outcomes in business related classes? A neural network and bayesian analyses. Research in Higher Education, 53(3), 353-374. https://doi.org/10.1007/s11162–011–9229–0
[17]. Galbraith, J. M. (2012). Using student competition field trips to increase teaching and learning effectiveness. Journal of Natural Resources and Life Sciences Education, 41(1), 54-58.
[18]. Goorha, P., & Mohan, V. (2010). Understanding learning preferences in the business school curriculum. Journal of Education for Business, 85(3), 145–152. https://doi.org/10.1080/08832320903252363
[19]. Gravestock, P., & Gregor–Greenleaf, E. (2008). Student course evaluations: Research, models and trends. Toronto, ON: Higher Education Quality Council of Ontario.
[20]. Haladyna, T. M., & Amrein–Beardsley, A. (2009). Validation of a research–based student survey of instruction in a college of education. Educational Assessment, Evaluation and Accountability, 21(3), 255-276. https://doi.org/10.1007/s110 92–008–9065–8
[21]. Hunsaker, S. L., Nielsen, A., & Bartlett, B. (2010). Correlates of teacher practices influencing student outcomes in reading instruction for advanced readers. Gifted Child Quarterly, 54(4), 273–282. https://doi.org/10.1177/001698621037 4506
[22]. James, A. R., Griffin, L., & Dodds, P. (2009). Perceptions of middle school assessment: An ecological view. Physical Education & Sport Pedagogy, 14(3), 323–334. https://doi.org/10.1080/17408980802225792
[23]. Keeley, J., Furr, R., & Buskist, W. (2010). Differentiating psychology students' perceptions of teachers using the teacher behavior checklist. Teaching of Psychology, 37(1), 16–20. https://doi.org/10.1080/00986280903426282
[24]. Kozub, R. M. (2010). Relationship of course, instructor, and student characteristics to dimensions of student ratings of teaching effectiveness in business schools. American Journal of Business Education, 3(1), 33-40.
[25]. Laragy, C., & Ottmann, G. (2011). Towards a framework for implementing individual funding based on an Australian case study. Journal of Policy and Practice in Intellectual Disabilities, 8(1), 18-27. https://doi.org/10.1111/j.1741–1130.2011. 00283.x
[26]. Maclellan, E. (2008). The significance of motivation in student–centred learning: A reflective case study. Teaching in Higher Education, 13(4), 411-421. https://doi.org/10.1080/13562510802169681
[27]. Madden, T. J., Dillon, W. R., & Leak, R. L. (2010). Students' evaluation of teaching: Concerns of item diagnosticity. Journal of Marketing Education, 32(3), 264-274. https://doi.org/10.1177/0273475310377759
[28]. Marsh, H. W. (2007). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The Scholarship of teaching and learning in higher education: An evidencebased perspective (pp. 319-383). Dordrecht, The Netherlands: Springer.
[29]. Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92(1), 202-228. https://doi.org/10. 1037/0022–0663.92.1.202
[30]. Martinez, G., Perez, A., Suero, M., & Pardo, P. J. (2013). The effectiveness of concept maps in teaching physics concepts applied to engineering education: Experimental comparison of the amount of learning achieved with and without concept maps. Journal of Science Education and Technology, 22(2), 204-214.
[31]. Mason, J. (2002). Qualitative researching (2 ed.). Thousand Oaks, CA: Sage.
[32]. McKeachie, W. J. (1979). Student ratings of faculty: A reprise. Academe, 65, 384–397.
[33]. McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52(11), 1218-1225. https://doi.org/ 10.1037/0003–066X.52.11.1218
[34]. McKeachie, W. J. (2007). Good teaching makes a difference—And we know what it is. In R. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence–based perspective (pp. 457–474). Netherlands: Springer.
[35]. Miles, M. B. (1979). Qualitative data as an attractive nuisance: The problem of analysis. Administrative Science Quarterly, 24(4), 590-601.
[36]. Nurani, L. M. (2008). Critical review of ethnographic approach. Jurnal Sosioteknologi, 7(14), 441-447.
[37]. Padgett, D. K. (2003). The qualitative research experience (1st ed.). Belmont, CA: Brooks/Cole Cengage Learning.
[38]. Pounder, J. (2007). Is student evaluation of teaching worthwhile? An analytical framework for answering the question. Quality Assurance in Education, 18(1), 47-63.
[39]. Ritchie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In A. Bryman& R. G. Burgess (Eds.), Analysing qualitative data (vol. 2, pp. 173-194). London, England: Routledge.
[40]. Safavi, S., Bakar, K., Tarmizi, R., & Alwi, N. (2012). The role of student ratings of instruction from perspectives of the higher education administrators. International Journal of Business and Social Science, 3(9), 233–239.
[41]. Scandura, T. A., & Williams, E. A. (2000). Research methodology in management: Current practice, trends, and implications for future research. Academy of Management Journal, 43(6), 1248-1264.
[42]. Schrodt, P., Witt, P. L., Myers, S. A., Turman, P. D., Barton, M. H., & Jernberg, K. A. (2008). Learner Empowerment and Teacher Evaluations as Functions of Teacher Power Use in the College Classroom. Communication Education, 57(2), 180- 200. https://doi.org/10.1080/03634520701840303
[43]. Skowronek, J., Friesen, B., & Masonjones, H. (2011). Developing a statistically valid and practically useful student evaluation instrument. International Journal for the Scholarship of Teaching and Learning, 5(1), 1–19.
[44]. Smart, K. L., Witt, C., & Scott, J. P. (2012). Toward learner–centered teaching: An inductive approach. Business Communication Quarterly, 75(4), 392-403. https://doi.org/10.1177/1080569912459752
[45]. Sprinkle, J. E. (2008). Student perceptions of effectiveness: An examination of the influence of student biases. College Student Journal, 42(2), 276-293.
[46]. Stehle, S., Spinath, B., & Kadmon, M. (2012). Measuring teaching effectiveness: Correspondence between students' evaluations of teaching and different measures of student learning. Research in Higher Education, 53(8), 888-904. https:// doi.org/10.1007/s11162–012–9260–9
[47]. Stowell, J. R., Addison, W. E., & Smith, J. L. (2012). Comparison of online and classroom–based student evaluations of instruction. Assessment & Evaluation in Higher Education, 37(4), 465-473. https://doi.org/10.1080/02602938.2010.545869
[48]. Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Thousand Oak, CA: Sage.
[49]. Svinivki, M., & Mckeachie, W. J. (2010). McKeachie's teaching tips: Strategies, research and theory for college and university teachers. Boston, MA: Houghton Mifflin.
[50]. Taras, V., Caprar, D. V., Rottig, D., Sarala, R. M., Zakaria, N., Zhao, F., ... & ZengyuHaung, V. (2013). A global classroom? Evaluating the effectiveness of global virtual collaboration as a teaching tool in management education. Academy of Management Learning and Education, 12(3), 414-435. https://doi.org/10.5465/amle.2012.0195
[51]. Titus, J. (2008). Student ratings in a consumerist academy: Leveraging pedagogical control and authority. Sociological Perspective, 51, 397-422.
[52]. Webb, L., De Lange, P., & O'Connell, B. (2009). A programme to expose students to senior executives in the world of accounting: An innovative learning method. Accounting Education, 18(2), 183-205. https://doi.org/10.1080/09639280802 436723
[53]. Wright, S., & Grenier, M. (2009). Examining effective teaching via a social constructive pedagogy "Case Study". Education, 130(2), 255-264.
[54]. Yin, R. (2013). Case study research: Design and methods (5 ed.). Thousand Oaks, CA: Sage.
[55]. Yin, R. K. (1981). The case study crisis: Some answers. Administrative Science Quarterly, 26(1), 58-65.
[56]. Yu, Z., Zhiming, C., & Harvie, C. (2013). The roles of size and size difference in Australian and Chinese inter–firm collaborations. Australasian Accounting Business and Finance Journal, 7(2), 33-48.
[57]. Zhao, J., & Gallant, D. J. (2012). Student evaluation of instruction in higher education: exploring issues of validity and reliability. Assessment & Evaluation In Higher Education, 37(2), 227-235. https://doi.org/10.1080/02602938.2010.523819
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Online 15 15

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.