Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing

Duisebek Nurgabyl; Gulmira Kalzhanova; Nurzhan Ualiyev; Gulsim Abdoldinova

doi:10.12973/ejmste/79796

Full Text (PDF)

Duisebek Nurgabyl ¹ ^* , Gulmira Kalzhanova ¹, Nurzhan Ualiyev ¹, Gulsim Abdoldinova ²

More Detail

¹ Zhetysu State University named after I. Zhansugurov, KAZAKHSTAN² Kazakh University of Technology and Business, KAZAKHSTAN^* Corresponding Author

Abstract

The relevance of this study is determined by the algorithm developed for test task selection. The purpose of this article is to develop this test task selection algorithm having single and multiple-choice answers with various blocks of reactions. The main approach to the study of the problem is the construction of a mathematical model to calibrate test task parameters and the university students’ scale of knowledge level. The study has proven insufficient use of the classical theory of testing in an objective assessment of students’ knowledge. The method for calibrating test task parameters is developed. Scales of testees’ readiness level are defined. The adequate size of test reliability coefficient is found. The rule for test task selection is formulated. A formula for the complexity degree of a test task is found. An algorithm for allocation of test task types with unambiguous and multiple-choice answers with various blocks of reactions is offered.

Keywords

test tasks
knowledge assessment
higher education
single choice answer
multiple choices

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

EURASIA J Math Sci Tech Ed, 2017, Volume 13, Issue 11, 7421-7429

https://doi.org/10.12973/ejmste/79796

Publication date: 06 Nov 2017

Article Views: 2234

Article Downloads: 946

Open Access References How to cite this article

References

Avanessov, V. S. (2009). The language of pedagogical measurements. Pedagogical Measurements, 2, 29-60. http://testolog.narod.ru/Theory65.html [in Russian].
Avanessov, V. S. (2014). New educational technology in university. Bulletin of the Russian University of Peoples’ Friendship, a series of education issues: languages and specialty, 4, 138-144. [in Russian].
Boesen, J., Lithner, J., & Palm, T. (2010). The relation between types of assessment tasks and the mathematical reasoning students use. Educational studies in mathematics, 75(1), 89-105. doi:10.1007/s10649-010-9242-9.
Bortz, J., & Döring, N. (2005). Forschungsmethoden und Evaluation. Heidelberg: Springer-Verlag. doi:10.1007/978-3-662-07299-8.
Borzykh, A. A., & Gorbunov, A. S. (2009). Virtual worlds, information environments and ambitions e-Learning. Educational Technology & Society, 12(2), 423-437. https://cyberleninka.ru/article/v/virtualnye-miry-informatsionnye-sredy-i-ambitsii-e-learning [in Russian].
Botti, A., Grimaldi, M., Tommasetti, A., Troisi, O., & Vesci, M. (2017). Modeling and Measuring the Consumer Activities Associated with Value Correction: An Exploratory Test in the Context of Education. Service Science, 9(1), 63-73. doi:10.1287/serv.2016.0156.
Chen, C., Wang, J., & Yu, C. (2017). Assessing the attention levels of students by using a novel attention aware system based on brainwave signals. British J. of Educational Technology, 48(2), 348-369. doi:10.1111/bjet.12359.
Cheng, Y., Diao, Q., & Behrens, J. T. (2017). A simplified version of the maximum information per time unit method in computerized adaptive testing. Behavior Research methods, 49(2), 502-512. doi:10.3758/s13428-016-0712-6.
Coe, R. (2003). Web-based nuclear testing & training. Nuclear Plant Journal, 21(1), 47-61. https://www.highbeam.com/doc/1P3-318821101.html.
De Meo, P., Messina, F., Rosaci, D., & Sarné G. M. L. (2017). Combining trust and skills evaluation to form e-Learning classes in online social networks. Information Sciences, 405, 107-122. doi:10.1016/j.ins.2017.04.002.
de Villiers, M. R. (Ruth), & Becker, D. (2017). Investigating learning with an interactive tutorial: A mixed-methods strategy. Innovations in Education and Teaching International, 54(3), 247-259. doi:10.1080/14703297.2016.1266959.
Dvoryatkina, S. N. (2013). Designing adaptive computerized training system tasks probabilistic-statistical areas of mathematics. Bulletin of the Russian Peoples Friendship University, Series Informatization of Education, 1, 97-104. [in Russian].
Edens, K., & Shields, C. A. (2015). Vygotskian approach to promote and formatively assess academic concept learning. Assessment & Evaluation in Higher Education, 40(7), 928-942. doi:10.1080/02602938.2014.957643.
Guznenkov V. N., & Seregin V. I. (2016). Computer testing as a form of control knowledge of students on geometric-graphic disciplines. International Research Journal, Series: Pedagogical Sciences, 9(51), 56-58. [in Russian].
Haist, S. A., Butler, A. P., & Paniagua, M. A. (2017). Testing and evaluation: the present and future of the assessment of medical professionals. Advances in Physiology Education, 41(1), 149-153. doi:10.1152/advan.00001.2017.
Horton, W., & Horton K. (2005). E-learning: tools and technologies. Moscow: Kudits-Image. [in Russian].
Howard, S. J., Woodcock, S., Ehrich, J., Bokosmaty, S., & others (2017). What are standardized literacy and numeracy tests testing? Evidence of the domain-general contributions to students’ standardized educational test performance. British J. of Educational Psychology, 87(1), 108-122. doi:10.1111/bjep.12138.
Huang, H. T. D., & Hung, S. T. A. (2010). Examining the practice of a reading-to-speak test task: anxiety and experience of EFL students. Asia Pacific Education Review, 11(2), 235-242. doi:10.1007/s12564-010-9072-6.
Hung, J. (2012). Trends of E‐learning Research from 2000 to 2008, Use of text mining and bibliometrics. British J. of Educational Technology, 43(1), 5–16. doi:10.1111/j.1467-8535.2010.01144.x.
Kibzun, A. I., & Inozemtsev, A. O. (2014). Using the maximum likelihood method to estimate test complexity levels. Automation and Remote control, 75(4), 607-621. doi:10.1134/S000511791404002X.
Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational studies in mathematics, 82(1), 145-164. doi:10.1007/s10649-012-9414-x.
Markon, K. E. (2013). Information Utility: Quantifying the Total Psychometric Information Provided by a Measure. Psychological Methods, 18(1), 15-35. doi:10.1037/a0030638.
Martos-Garcia, D., Usabiaga, O., & Valencia-Peris, A. (2017). Students’ Perception on Formative and Shared Assessment: Connecting two Universities through the Blogosphere. Journal of new Approaches in Educational Research, 6(1), 64-70. doi:10.7821/naer.2017.1.194.
Nurgabyl, D. N. (2014a). About one mathematical model of calibration of parameters of test tasks. Bulletin of KazNTU named after K. Satpayev, 3, 482-487. http://vestnik.kazntu.kz/files/newspapers/81/2669/2669.pdf [in Russian].
Nurgabyl, D. N. (2014b). On a mathematical model of multi-step adaptive testing. Bulletin of the Abai Kazakh National Pedagogical University, a Series of Physical and Mathematical Sciences, 1(45), 143-149. [in Russian].
Nurgabyl, D. N. (2012). On a computer adaptive testing technology in vocational training. Proceedings of the international scientific-practical conference “Mathematical, science education and information”, 2, (316-319). Moscow: Institute of Mathematics and Informatics. [in Russian].
Nurgabyl, D. N., & Ramazanov, R. G. (2013). About one model of adaptive computerized testing. Proceedings of the International Conference on the Transformation of Education, Mathematics, (pp.13-21). London.
Nurjanah, Dahlan, J. A., & Wibisono, Y. (2017). Design and Development Computer-Based E-Learning Teaching Material for Improving Mathematical Understanding Ability and Spatial Sense of Junior High School Students. Proceedings of the 3rd International Seminar on Mathematics, Science, and Computer Science Education (MSCEIS), Bandung, Indonesia, 2016, Journal of Physics Conference Series, 812, UNSP 012098. doi:10.1088/1742-6596/812/1/012098.
Ozturk, N., & Dogan, N. (2015). Investigating Item Exposure Control Methods in Computerized Adaptive Testing. Educational sciences-theory & practice, 15(1). 85-89. doi:10.12738/estp.2015.1.2593.
Pantziara, M., & Philippou, G. (2012). Levels of students’ “conception” of fractions. Educational studies in mathematics, 79(1), 61-83. doi:10.1007/s10649-011-9338-x.
Park, J. (2010). Constructive multiple‐choice testing system. British J. of Educational Technology, Special Issue, Learning objects in progress, 41(6), 1054–1064. doi:10.1111/j.1467-8535.2010.01058.x.
Permyakov, O. E., & Maksimov, O. A. (2015). Formalization of expert evaluation of the quality of test materials from the positions of the system approach. Vestnik pedagogicheskikh innovatsii, 3(7), 157-178. [in Russian].
Prado, E., Hartini, S., & Rahmawati, A. et al. (2010). Test selection, adaptation, and evaluation: A systematic approach to assess nutritional influences on child development in developing countries. British J. of Educational Psychology, 80(1), 31-53. doi:10.1348/000709909X470483.
Rasch, G. (1980). Probabilistic Models for Some Intelligence and Attainment Tests. Chicago: The University of Chicago Press.
Sangwin, C. J., & Jones, I. (2017). Asymmetry in student achievement on multiple-choice and constructed-response items in reversible mathematics processes. Educational studies in mathematics, 94(2), 205-222. doi:10.1007/s10649-016-9725-4.
Senior, C., Fearon, C., & Mclaughlin, H. et al. (2017). How might your staff react to news of an institutional merger? A psychological contract approach. International Journal of Educational management, 31(3), 364-382. doi:10.1108/IJEM-05-2016-0087.
Siddiq, F., Gochyyev, P., & Wilson, M. (2017). Learning in Digital Networks. ICT literacy: A novel assessment of students’ 21st century skills. Computers & Education, 109, 11-37. doi:10.1016/j.compedu.2017.01.014.
van der Linden, W. J., & Glas, C. A. W. (Eds.) (2010). Elements of Adaptive Testing. Springer. doi:10.1007/978-0-387-85461-8.
van Rijn, P. W., & Ali, U. S. (2017). A comparison of item response models for accuracy and speed of item responses with applications to adaptive testing. British J. of Mathematical & Statistical Psychology, 70(2), SI, 317-345. doi:10.1111/bmsp.12101.
Vasiliev V. N. (2007). University as an open system. Innovations, 2, 57-60. https://elibrary.ru/item.asp?id=12898737 [in Russian].
Vlasin, I., & Chirila, C. B. (2015). The model of a competence based e-learning platform for primary and middle school students. Smart 2014-Social media in academia: Research and Teaching, 179-184 http://www.academia.edu/9872137/The_model_of_a_competence_based_e-learning_platform_for_primary_and_middle_school_students.
Voutilainen, A., Saaranen, T. S., & Ormunen, M. (2017). Conventional vs. e-learning in nursing education: A systematic review and meta-analysis. Nurse Education Today, 50, 97-103. doi:10.1108/IJEM-05-2016-0087.
Wilmot, D. B., Schoenfeld, A., Wilson, M., Champney, D., & Zahner, W. (2011). Validating a Learning Progression in Mathematical Functions for College Readiness. Mathematical Thinking and learning, 13(4), 259-291. doi:10.1080/10986065.2011.608344.
Wilson, M. (2005). Constructing Measures: An Item Response Modeling Approach. Mahwah, New Jersey: Lawrence Erlbaum Associates.
Xia, Q., Liang, R., & Wu, J. (2017). Transformed contribution ratio test for the number of factors in static approximate factor models. Computational statistics & Data Analysis, 112, 235-241. doi:10.1016/j.csda.2017.03.005.
Yaman, S. (2011). Comparison of test use and multiple-evaluation to test effectiveness of PBL in different grouping strategies. Energy Education Science and Technology, Part B-social and Educational studies, 3(1-2), 131-142.

How to cite this article

APA

Nurgabyl, D., Kalzhanova, G., Ualiyev, N., & Abdoldinova, G. (2017). Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing. Eurasia Journal of Mathematics, Science and Technology Education, 13(11), 7421-7429. https://doi.org/10.12973/ejmste/79796

Vancouver

Nurgabyl D, Kalzhanova G, Ualiyev N, Abdoldinova G. Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing. EURASIA J Math Sci Tech Ed. 2017;13(11):7421-9. https://doi.org/10.12973/ejmste/79796

AMA

Nurgabyl D, Kalzhanova G, Ualiyev N, Abdoldinova G. Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing. EURASIA J Math Sci Tech Ed. 2017;13(11), 7421-7429. https://doi.org/10.12973/ejmste/79796

Chicago

Nurgabyl, Duisebek, Gulmira Kalzhanova, Nurzhan Ualiyev, and Gulsim Abdoldinova. "Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing". Eurasia Journal of Mathematics, Science and Technology Education 2017 13 no. 11 (2017): 7421-7429. https://doi.org/10.12973/ejmste/79796

Harvard

Nurgabyl, D., Kalzhanova, G., Ualiyev, N., and Abdoldinova, G. (2017). Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing. Eurasia Journal of Mathematics, Science and Technology Education, 13(11), pp. 7421-7429. https://doi.org/10.12973/ejmste/79796

MLA

Nurgabyl, Duisebek et al. "Construction of a Mathematical Model for Calibrating Test Task Parameters and the Knowledge Level Scale of University Students by Means of Testing". Eurasia Journal of Mathematics, Science and Technology Education, vol. 13, no. 11, 2017, pp. 7421-7429. https://doi.org/10.12973/ejmste/79796