i-manager Publications

AMOVA [“Accumulative Manifold Validation Analysis”]: An Advanced Statistical Methodology Designed To Measure and Test the Validity, Reliability, and Overall Efficacy of Inquiry–Based Psychometric Instruments

James Edward Osler II*

Faculty Member, Department of Curriculum and Instruction, School of Education, North Carolina Central University (NCCU), USA.

Periodicity:October - December'2015
DOI : https://doi.org/10.26634/jet.12.3.3742

Abstract

This monograph provides an epistemological rational for the Accumulative Manifold Validation Analysis [also referred by the acronym “AMOVA”] statistical methodology designed to test psychometric instruments. This form of inquiry is a form of mathematical optimization in the discipline of linear stochastic modelling. AMOVA is an in–depth statistical procedure for the internal testing of research instruments based on the metrics from the novel “Taxonomy of Process Education”. The Taxonomy of Process Education (TPE) is based off of the Process Education (PE), four–level measures designed to measure self–growth. The PE four levels in particular are viewed as sequential stages (or phases) of professional development. The four levels are also constructed to build towards the highest level of content knowledge or subject matter expertise (Pacific Crest, 2015). The TPE metric has universal applicability and is ideally suited for weighted mathematical measurement of content (subject matter), knowledge (cognitive), disposition (affective), and capability (psychomotor). This original methodology is a novel approach to advanced statistical post hoc data analysis. It adds considerable value to the methods designed to assess instrument validity and reliability especially when said instrumentation is researcher–designed. A sequential AMOVA mathematical model is provided (for sample data “Crosswise–Validation Analysis”) along with its associated PE Taxonomy and measurement metrics in a step-by-step fashion that illustrates the entire process of advanced instrument validation inquiry.

Keywords

AMOVA, AMOVA Cluster Axiom for Manifold Consistency, Analysis, Accumulative, Accumulative Manifold Validation, Cluster, Crosswise–Validation, Linear Stochastic Modelling, Manifold, Mathematical Model, Mathematical Optimization, Mean, Outcomes, Process Education, Psychometrics, Research, Statistical Test, Statistics, Taxonomy of Process Education, Validation

How to Cite this Article?

Osler, J. E., II. (2015). AMOVA [“Accumulative Manifold Validation Analysis”]: An Advanced Statistical Methodology Designed To Measure and Test the Validity, Reliability, and Overall Efficacy of Inquiry–Based Psychometric Instruments. i-manager’s Journal of Educational Technology, 12(3), 19-29. https://doi.org/10.26634/jet.12.3.3742

References

[1]. Allen, D. M. (1974). “The relationship between variable selection and data agumentation and a method for prediction”. Technometrics, Vol.16(1), pp.125-127.

[2]. Bengio, Y., and Grandvalet, Y. (2004). “No unbiased estimator of the variance of k-fold cross-validation”. The Journal of Machine Learning Research, Vol.5, pp.1089-1105.

[3]. Dietterich, T. G. (1998). “Approximate statistical tests for comparing supervised classification learning algorithms”. Neural computation, Vol.10(7), pp.1895-1923.

[4]. Geisser, S. (1975). “The predictive sample reuse method with applications”. Journal of the American Statistical Association, Vol.70(350), pp.320-328.

[5]. Harrell, F., Lee, K., and Mark, D. (1996). “Tutorial in Biostatistics: Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors”. Statistics in Medicine, Vol.15, pp.361 – 387.

[6]. INFORMS, (2015). The Nature of Mathematical Programming, Mathematical Programming Glossary, INFORMS Computing Society.

[7]. Krstajic, D., Buturovic, L. J., Leahy, D. E., and Thomas, S. (2014). “Cross-validation pitfalls when selecting and assessing regression and classification models”. Journal of cheminformatics, Vol.6(1), pp.1-15.

[8]. Mayoraz, E., and Alpaydin, E. (1999). “Support vector machines for multi-class classification”. In Engineering Applications of Bio-Inspired Artificial Neural Networks, pp. 833-842. Springer Berlin Heidelberg.

[9]. Osler, J. E. (2010). Techtonics ™ ©: Optimal learning via instructional solutions developed through the methodology of technology engineering (1sted.), Lulu Publishing, Morrisville NC.

[10]. Osler, J. E. (2014a). “Triostatistics: The Application of Innovative In–Depth Advanced Post Hoc Statistical Metrics for the Assessment and Analysis of Statistically Significant Tri–Squared Test Outcomes”. Kentucky Journal of Excellence in College Teaching and Learning, Vol.12 (3), pp. 27–39.

[11]. Osler, J. E. (2014b). “Introducing Trinova: “Trichotomous Nomographical Variance” a Post Hoc Advanced Statistical Test of Between and Within Group Variances of Trichotomous Categorical and Outcome Variables of a Significant Tri–Squared Test”. i-manager's Journal on Mathematics, 3(4), Oct-Dec 2014, Print ISSN 2277-5129, E-ISSN 2277-5137, pp. 1-14.

[12]. Pacific Crest. (2015). Process Education.

[13]. Refaeilzadeh, P., Tang, L., and Liu, H. (2009). Crossvalidation. In Encyclopedia of Database Systems, pp. 532-538. Springer US.

[14]. Rust, J. and Golombok, S. (1989). Modern Psychometrics: The Science of Psychological Assessment, 2nd ed.. Florence, KY, US: Taylor & Frances/Routledge.

[15]. Searle, S. R., Casella, G., and McCulloch, C. E. (1992). Variance Components. New York: Wiley.

[16]. Shapiro, A., Dentcheva, D. and Ruszczyski, A. (2009). Lectures on stochastic programming: Modeling and theory. MPS/SIAM Series on Optimization 9. Mathematical Programming Society (MPS). pp. xvi+436. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[17]. Starkweather, J. (2013). “Cross Validation techniques in R: A brief overview of some methods, packages, and functions for assessing prediction models”. Retrieved on May, 6, 2013.

[18]. Stone, M. (1974). “Cross-validatory choice and assessment of statistical predictions”. Journal of the Royal Statistical Society, Series B (Methodological), pp.111-147.

If you have access to this article please login to view the article or kindly login to purchase the article

Single Article

	North Americas,UK, Middle East,Europe		India	Rest of world
	USD	EUR	INR	USD-ROW
Online	15	15

ADD TO CART

Options for accessing this content:

If you would like institutional access to this content, please recommend the title to your librarian.
If you already have i-manager's user account: Login above and proceed to purchase the article.
New Users: Please register, then proceed to purchase the article.