Abstract
Learning through designing is the latest innovation in science, technology, engineering, and mathematics teaching and learning in the 21st century. This study aims to identify the effectiveness of EkSTEMiT module in fostering inventive thinking in the subject of electrochemistry. EkSTEMiT module was tested through a quasi-experimental design method of nonequivalent pre- and post-tests. A total of 63 students from four rural schools were involved in this study. Two schools were included in the treatment group (n=32), and two schools were included in the control group (n=31). The instrument used in this study was Inventive Thinking Questionnaire, which consists of adaptability and complexity management, self-regulation, curiosity, creativity, risk-taking, and higher-order thinking and reasoning subdomains. Analysis of MANOVA repeated measures showed no significant effect for group and time and no significant interaction effect between group and time on the level of students’ inventive thinking. Although EkSTEMiT module does not have a significant impact on the level of inventive thinking, it can have a particular impact on the teaching of innovative instructors and can subsequently increase interest in the subject of chemistry among students.
License
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Article Type: Research Article
EURASIA J Math Sci Tech Ed, 2023, Volume 19, Issue 12, Article No: em2374
https://doi.org/10.29333/ejmste/13883
Publication date: 01 Dec 2023
Online publication date: 10 Nov 2023
Article Views: 683
Article Downloads: 494
Open Access References How to cite this articleReferences
- Abdullah, M. (2011). 21st inventive thinking skills in science among primary students in Malaysia and Brunei [Undergraduate thesis, Universiti Kebangsaan Malaysia].
- Abdullah, M., & Osman, K. (2010). 21st century inventive thinking skills among primary students in Malaysia and Brunei. Procedia-Social and Behavioral Sciences, 9, 1646-1651. https://doi.org/10.1016/j.sbspro.2010.12.380
- Ackermann, E. (2001). Piaget’s constructivism, Papert’s constructionism: What’s the difference? Future of Learning Group Publication, 5(3), 438-449.
- Adnan, M., & Ismail, N. S. (2018). The willingness of mathematics teachers in facing 21st century skills. Turkish Online Journal of Design, Art and Communication, 8, 1346-1353. https://doi.org/10.7456/1080SSE/180
- Allina, B. (2018). The development of STEM educational policy to promote student creativity and social empowerment. Art Educational Policy Review, 119(2), 77-87. https://doi.org/10.1080/10632913.2017.1296392
- Alrawili, K. S., Osman, K., & Almuntasheri, S. (2020). Effects of scaffolding strategies in higher-order thinking skills in science classroom. Journal Of Baltic Science Education, 19(5), 718-729. https://doi.org/10.33225/jbse/20.19.718
- Arsad, N. M., Osman, K., & Soh, T. M. T. (2011). Instrumen development for 21st century skills in biology. Procedia-Social and Behavioral Sciences, 15, 1470-1474. https://doi.org/10.1016/j.sbspro.2011.03.312
- Besser, A., Flett, G. L., & Zeigler-Hill, V. (2022). Adaptability to a sudden transition to online learning during the COVID-19 pandemic: Understanding the challenges for students. Scholarship Of Teaching and Learning in Psychology, 8(2), 85-105. https://doi.org/10.1037/stl0000198
- Bruckman, A. (1998). Community support for constructionist learning. Computer Supported Cooperative Work, 7(1), 47-86. https://doi.org/10.1023/A:1008684120893
- Burrows, A. C., Borowczak, M., Myers, A., Schwortz, A. C., & McKim, C. (2021). Integrated STEM for teacher professional learning and development: “I need time for practice”. Education Sciences, 11(1), 21. https://doi.org/10.3390/educsci11010021
- Cankaya, E. M., Liew, J., & De Freitas, C. P. P. (2018). Curiosity and autonomy as factors that promote personal growth in the cross-cultural transition process of international students. Journal Of International Students, 8(4), 1694-1708. https://doi.org/10.32674/jis.v8i4.225 3
- Chifamba, T., & Wijaya, C. (2020). Creativity in relation to academic and clinical performance of dentistry students. Asian Journal of Education and Social Studies, 8(1), 1-7. https://doi.org/10.9734/ajess/2020/v8i130209
- Cremin, T., Glauert, E., Craft, A., Compton, A., & Styliandou, F. (2015). Creative little scientist: Exploring pedagogical synergies between inquiry-based and creative approaches in early years science. In Creativity and Creative Pedagogies in The Early And Primary Years (pp 45-60). Routledge. https://doi.org/10.1080/03004279.2015.1020655
- De Corte, E. (2019). Learning design: Creating powerful learning environment for self-regulation skills. Educational Studies Moscow, 4, 30-46. https://doi.org/10.17323/1814-9545-2019-4-30-46
- Deniz, H., Yesilyurt, E., Kaya, E., Newley, A., & Lin, E. (2020). Integrating engineering, science, reading, and robotics across grades 3-8 in a STEM education era. In Proceedings of the Society for Information Technology & Teacher Education International Conference (pp. 885-891). Association for the Advancement of Computing in Education.
- Douglas, K. A., Moore, T. J., Johnston, A. C., & Merzdorf, H. E. (2018). Informed designers? Students’ reflections on their engineering design process. International Journal of Education in Mathematics, Science and Technology, 6(4), 443-459. https://doi.org/10.18404/ijemst.440347
- Echazarra, A., & Radinger, T. (2019). Learning in rural schools: Insights from PISA, TALIS and the literature. OECD Publishing.
- English, M. C., & Kitsantas, A. (2013). Supporting student self-regulated learning in problem- and project-based learning. Interdisciplinary Journal of Problem-Based Learning, 7, 128-150. https://doi.org/10.7771/1541-5015.1339
- Fulton, K., Doerr, H., & Britton, T. (2010). STEM teachers in professional learning communities: A knowledge synthesis. National Commission on Teaching and America’s Future.
- Gardner, M. (2017). Beyond the acronym: Preparing preservice teachers for integrated STEM education. AILACTE Journal, 14(1), 37-53.
- Gorgoz, S., & Tican, C. (2020). Investigation of middle school student's self regulation skills and vocabulary learning strategies in foreign language. International Journal of Educational Methodology, 6(1), 25-42. https://doi.org/10.12973/ijem.6.1.25
- Hadi, S., Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4) 520-532. https://doi.org/10.33225/pec/18.76.520
- Han, J., Kelley, T., Bartholomew, S., & Knowles, G. (2020). Sharpening “STEL” with integrated STEM. Technology and Engineering Teacher, 80(3), 24-29.
- Hassan, M., & Osman, K. (2016). Pembelajaran biologi berasaskan projek [Project-based biology learning]. Penerbit Universiti Kebangsaan Malaysia.
- Hernández-Torrano, D. (2018). Urban-rural excellence gaps: Features, factors, and implications. Roeper Review, 40(1), 36-45. https://doi.org/10.1080/02783193.2018.1393610
- Hill-Cunningham, P. R., Mott, M. S., & Hunt, A. B. (2018). Facilitating an elementary engineering design process module. School Science and Mathematics, 118(1-2), 53-60. https://doi.org/10.1111/ssm.12259
- Hwang, C. I., & Kim, S. H. (2016). How are serious games used in the classroom setting?–Based on the learning theory. Indian Journal of Science and Technology, 9(26), 1-6. https://doi.org/10.17485/ijst/2016/v9i26/97307
- Jackson, J. K., Forsythe, M., Parthemore, J., Rix, A., & Medeiros, D. (2021). Innovation and design. Science and Children, 58(3), 26-31.
- Kafai, Y. B., & Resnick, M. (2011). Introduction to constructionism. In Y. B. Kafai, & M. Resnick (Eds.), Constructionism in practice: Designing, thinking and learning in a digital world (pp. 1-8). Routledge. https://doi.org/10.4324/9780203053492
- Kaloti-Hallak, F., Armoni, M., & Ben-Ari, M. (2019). The effect of robotics activities on learning the engineering design process. Informatics in Education, 18(1), 105-129. https://doi.org/10.15388/infedu.2019.05
- Kan’an, A. (2018). The Relationship between Jordanian students’ 21st century skills (Cs21) and academic achievement in science. Journal of Turkish Science Education, 15(2), 82-94.
- Kim, H. J., Yi, P., & Hong, J. I. (2020). Students' academic use of mobile technology and higher-order thinking skills: The role of active engagement. Education Sciences, 10(3) 47.
- Kiong, T. T., Saien, S., Rizal, F., Yee, M. H., Mohamad, M. M., Othman, W., Azman, M. N. A., & Azid, N. (2020). Design and technology teacher in TVET: A view on thinking style and inventive problem-solving skill. Journal of Technical Education and Training, 12(1), 197-203.
- Kraniewski, A., & Woznicki, J. (1998). Flexibility and adaptability in engineering education: an academic institution perspective. IEEE Transactions on Education, 41(4), 237-246. https://doi.org/10.1109/13.728256
- Kruger, L. G., & Gilroy, A. A. (2013). Broadband internet access and the digital divide: Federal assistance programs. CRS.
- Kumar, T. (2020). Approaches in teaching writing skills with creative writing: A TESOL study for Indian learners. TESOL International Journal, 15(5), 78-98.
- Langdon, D., McKittrick, G., Beede, D., Khan, B., & Doms, M. (2011). STEM: Good jobs now and for the future. U.S. Department of Commerce Economics and Statistic Administration.
- Lay, A. N., & Osman, K. (2015). Framework for 21st century chemistry instruction: A guide to teaching and learning of qualitative analysis. Technics Technologies Education Management, 10(2), 216-230.
- Lemke, C. (2002). enGauge 21st century skills: Literacy in the digital age. NCREL and METIRI.
- Lian, B., Kristiawan, M., & Fitriya, R. (2020). Giving creativity room to students through the friendly schools program. International Journal of Scientific And Technology Research, 7(7), 1-7. https://doi.org/10.31219/osf.io/zebpd
- Light, A., & Rama, A. (2019). Moving beyond the STEM/non-STEM dichotomy: Wage benefits to increase the STEM-intensities of college coursework and occupational requirements. Education Economics, 27(4), 358-382. https://doi.org/10.1080/09645292.2019.1616078
- Lin, K. Y., Wu, Y. T., Hsu, Y. T., & Williams, P. J. (2021). Effects of infusing the engineering design process into STEM project-based learning to develop preservice technology teachers’ engineering design thinking. International Journal of STEM Education, 8, 1. https://doi.org/10.1186/s40594-020-00258-9
- Lindholm, M. (2018). Promoting curiosity? Possibilities and pitfalls in science education. Science & Education, 27, 987-1002. https://doi.org/10.1007/s11191-018-0015-7
- Long, N. T., Yen, N. T. H., & Van Hanh, N. (2020). The role of experiential learning and engineering design process in K-12 STEM education. International Journal of Education and Practice, 8(4), 720-732. https://doi.org/10.18488/journal.61.2020.84.720.732
- Lytle, A., & Shin, J. E. (2020). Incremental beliefs, STEM efficacy and STEM interest among first-year undergraduate students. Journal of Science Education and Technology, 29(2), 272-281. https://doi.org/10.1007/s10956-020-09813-z
- Macalalag, A., Lowes, S., Guo, K., McKay, M., & McGrath, E. (2009). Promoting scientific inquiry through innovative science and engineering curricula in grades 3-5. In Proceedings of the 2009 Annual Conference & Exposition (pp. 14-99). https://doi.org/10.18260/1-2--5076
- Martinez, S. L., & Stager, G. (2013). Invent to learn: Making, tinkering, and engineering in the classroom. Constructing Modern Knowledge Press.
- Merolla, D. M., & Serpe, R. T. (2013). STEM enrichment programs and graduate school matriculation: The role of science identity salience. Social Psychology of Education, 16(4), 575-597. https://doi.org/10.1007/s11218-013-9233-7
- Mesutoglu, C., & Baran, E. (2020). Examining the development of middle school science teachers’ understanding of engineering design process. International Journal of Science and Mathematics Education, 18(8), 1509-1529. https://doi.org/10.1007/s10763-019-10041-0
- Ministry of Science, Technology, and Environment (2003). Second national sience and technology policy and action plans.
- Mohamad Said, M. M., & Yunus, N. (2008). Halangan-halangan kepada usaha memupuk kreativiti di kalangan pelajar [Obstacles to cultivating creativity among students]. In Proceedings of the Seminar on Soft Skills and Social Wellbeing (pp. 89-149).
- Moore, T. J., Glancy, A. W., Tank, K. M., Kersten, J. A., Smith, K. A., & Stohlmann, M. S. (2014). A framework for quality K-12 engineering education: Research and development. Journal of Pre-College Engineering Education Research, 4(1), 2. https://doi.org/10.7771/2157-9288.1069
- Murthi, K., & Patten, K. (2023). Improving executive functions using the engineering design process: A peer-mediated problem-solving approach for autistic adolescents. The American Journal of Occupation Therapy, 77(2), 7702347010. https://doi.org/10.5014/ajot.2023.050166
- Nath, G., & Gero, J. S. (2004). Learning while designing. AIEDAM, 18(4), 315-341. https://doi.org/10.1017/S089006040404020X
- National Research Council. (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. National Academies Press.
- Ngaewkoodrua, N., & Yuenyong, C. (2018). Teachers’ learning on the workshop of STS approach as a way of enhancing inventive thinking skills. AIP Conference Proceedings, 1923, 30030. https://doi.org/10.1063/1.5019521
- Ortiz-Revilla, J., Adúriz-Bravo, A., & Greca, I. M. (2020). A framework for epistemological discussion on integrated STEM education. Science & Education, 29(4), 857-880. https://doi.org/10.1007/s11191-020-00131-9
- Osman, K. (2015). Students as digital game designers: Addressing the 21st century chemistry education needs in Malaysia. In Proceedings of the 1st International Seminar on Chemical Education (pp. 6-20).
- Osman, K., & Lay, A. N. (2020). MyKimDG module: An interactive platform towards development of twenty-first century skills and improvement of students’ knowledge in chemistry. Interactive Learning Environments, 30(8), 1461-1474. https://doi.org/10.1080/10494820.2020.1729208
- Osman, K., & Marimuthu, N. (2010). Setting new learning targets for the 21st century science education in Malaysia. Procedia-Social and Behavioral Sciences, 2, 3737-3741. https://doi.org/10.1016/j.sbspro.2010.03.581
- Papert, S. A. (1971). A computer laboratory for elementary schools. https://eric.ed.gov/?id=ED077242
- Park, J. H. (2018). The research on an improvement of computational thinking through 3D modelling lesson based on storytelling. Journal Of Digital Content Society, 19(11), 2111-2117. https://doi.org/10.9728/dcs.2018.19.11.2111
- Pearl, S., & Bless, E. (2021). Trap the Zhu Zhu! Science and Children, 58(3), 72-75.
- Penman, J. & Thalluri, J. (2014). Addressing diversity in health science student by enhancing flexibility through e-learning. Electronic Journal Of E-learning, 12(1), 89-100.
- Penuel, W. R. (2019). Infrastructuring as a practice of design-based research for supporting and studying equitable implementation and sustainability of innovations. Journal of the Learning Sciences, 28(4-5), 659-677. https://doi.org/10.1080/10508406.2018.1552151
- Prahani, B., Jatmiko, B., Sunarto, D., Sagirani, T., Amelia, T., & Lemantara, J. (2020). Blended web mobile learning (BWML) model to improve students' higher-order thinking skills. International Journal of Emerging Technologies in Learning, 15(11), 42-55. https://doi.org/10.3991/ijet.v15i11.12853
- Prinsley, R., & Baranyai, K. (2015). STEM-trained and job-ready. Office of the Chief Scientist, 12, 1-4.
- Prinsley, R., & Baranyai, K. 2015. STEM skills in the workforce: What do employers want. Office of the Chief Scientist.
- Putra, P. D. A., Sulaeman, N. F., Supeno, & Wahyuni, S. (2021). Exploring student's critical thinking skills using the engineering design process in a physics classroom. The Asia-pacific Education Researcher, 32(1), 141-149. https://doi.org/10.1007/s40299-021-00640-3
- Reynante, B. M., Selbach-Allen, M. E., & Pimentel, D. R. (2020). Exploring the promises and perils of integrated STEM through disciplinary practices and epistemologies. Science & Education, 29(4), 785-803. https://doi.org/10.1007/s11191-020-00121-x
- Roehrig, G. H., Dare, E. A., Ring-Whalen, E., & Wieselmann, J. R. (2021). Understanding coherence and integration in integrated STEM curriculum. International Journal of STEM Education, 8, 2. https://doi.org/10.1186/s40594-020-00259-8
- Ronen-Fuhrmann, T., Kali, Y., & Hoadley, C. (2008). Helping education students understand learning through designing. Educational Technology, 48(2), 26-33.
- Rusk, N., Resnick, M., & Cooke, S. (2009). Origins and guiding principles of the computer clubhouse. In Y. B. Kafai, K. A. Peppler, R. N. Chapman, & M. C. Linn (Eds.), The computer clubhouse: Constructionism and creativity in youth communities (pp. 17-25). Teachers College Press.
- Sabourin, J., Mott, B., & Lester, J. (2013, July). Discovering behavior patterns of self-regulated learners in an inquiry-based learning environment. In Proceedings of the International Conference on Artificial Intelligence in Education (pp. 209-218). Springer. https://doi.org/10.1007/978-3-642-39112-5_22
- Saleh, S., Muhammad, A., & Abdullah, S. M. S. (2020). STEM project-based approach in enhancing conceptual understanding and inventive thinking skills among secondary school students. Journal of Nusantara Studies, 5(1), 234-254. https://doi.org/10.24200/jonus.vol5iss1pp234-254
- Samad, N., & Osman, K. (2017). EkSTEMiT learning module and inculcation of inventive thinking. K-12 STEM Education, 3(4), 259-266.
- Scaradozzi, D., Screpanti, L., & Cesaretti, L. (2019). Towards a definition of educational robotics: classification of tools, experiences and assessments. In L. Daniela (Ed.), Smart learning with educational robotics (pp. 63-92). Springer. https://doi.org/10.1007/978-3-030-19913-5_3
- Sen, S., Yilmaz, A., & Geban, O. (2015). The effects of process oriented guided inquiry learning environment on students’ self-regulated learning skills. Problems of Education in the 21st Century, 66, 54-66. https://doi.org/10.33225/pec/15.66.54
- Sirotiak, T., & Sharma, A. (2019). Problem-based learning for adaptability and management skills. Journal Of Professional Issues in Engineering Education and Practice, 145(4), 0401. https://doi.org/10.1061/(ASCE)EI.1943-5541.0000420
- Smit, K., de Brabander, C. J., & Martens, R. L. (2014). Student-centered and teacher-centered learning environment in pre-vocational secondary education: Psychological needs and motivation. Scandinavian Journal of Education Research, 58(6) 695-712. https://doi.org/10.1080/00313831.2013.821090
- Smith, E., & White, P. (2019). Where do all the STEM graduates go? Higher education, the labor market and career trajectories in the UK. Journal of Science Education and Technology, 28(1), 26-40. https://doi.org/10.1007/s10956-018-9741-5
- Supena, I., Darmuki, A., & Hariyadi, A. The influence of 4C (constructive, critical, creativity and collaborative) Learning Model of Students. International Journal of Instruction, 14(3), 873-892. https://doi.org/10.29333/iji.2021.14351a
- Thuneberg, H. M., Salmi, H. S., & Bogner, F. X. (2018). How creativity, autonomy, visual reasoning contribute to cognitive learning in a STAEM hands-on inquiry-based math module. Thinking Skills and Creativity, 29, 152-160. https://doi.org/10.1016/j.tsc.2018.07.003
- Tseng, H., Kuo, Y. C., & Walsh, E. J. (2020). Exploring first-time online undergraduate and graduate student's growth mindsets and flexible thinking and their relations to online learning engagement. Educational Technology Research and Development, 68, 2285-2303. https://doi.org/10.1007/s11423-020-09774-5
- Turiman, P., Osman, K., & Wook, T. S. M. T. (2020). Inventive thinking 21st century skills among preparatory course science students. Asia Pacific Journal of Educators and Education, 35(2), 145-170. https://doi.org/10.21315/apjee2020.35.2.9
- Vassallo, S. (2012). Observations of a working-class family: Implications for self-regulated learning development. Educational Studies, 48(6), 501-529. https://doi.org/10.1080/00131946.2011.647150
- Verner, I., & Korchnoy, E. (2006). Experiential learning through designing robots and motion behaviors: A tiered approach. International Journal of Engineering Education, 22(4), 758.
- Wan Husin, W. N. F., Mohamad Arsad, N., Othman, O., Halim, L., Rasul, M. S., Osman, K., & Iksan, Z. (2016). Fostering students’ 21st century skills through project oriented problem-based learning (POPBL) in integrated STEM education program. Asia-Pacific Forum on Science Learning & Teaching, 17(1), 3.
- Weitze, C. L. (2014). Developing goals and objectives for gameplay and learning. In Learning, education and games: Curricular and design considerations (pp. 225-249). Carnegie Mellon University ETC Press.
- Wilson-Lopez, A., Mejia, J. A., Hasbún, I. M., & Kasun, G. S. (2016). Latina/o adolescents’ funds of knowledge related to engineering. Journal of Engineering Education, 105(2), 278-311. https://doi.org/10.1002/jee.20117
- Winarno, N., Rusdiana, D., Samsudin, A., Susilowati, E., Ahmad, N. J., & Afifah, R. M. A. (2020). Synthesizing results from empirical research on engineering design process in science education: A systematic literature review. EURASIA Journal of Mathematics, Science and Technology Education, 16(12), em1912. https://doi.org/10.29333/ejmste/9129
- Wright, R., & Ellis, M. (2019). Where science, technology, engineering, and mathematics (STEM) graduates move: Human capital, employment patterns, and interstate migration in the United States. Population, Space and Place, 25(4), e2224. https://doi.org/10.1002/psp.2224
- World Economic Forum (2018). The future jobs report 2018.
- Yavuzalp, N., & Bahcivan, E. (2021). A structural equation modelling analysis of relationships among university students' readiness for e-learning, self-regulation skills, satisfaction, and academic achievement. Research and Practice in Technology Enhance Learning, 16(1), 15-32. https://doi.org/10.1186/s41039-021-00162-y
- Yee, M. H., Yunos, J. M., Othman, W., Hassan, R., Tee, T. K., & Mohamad, M. M. (2015). Disparity of learning styles and higher order thinking skills among technical students. Procedia-Social and Behavioral Sciences, 204, 143-152. https://doi.org/10.1016/j.sbspro.2015.08.127
- Yu, K. C., Wu, P. H., & Fan, S. C. (2020). Structural relationships among high school students’ scientific knowledge, critical thinking, engineering design process, and design product. International Journal of Science and Mathematics Education, 18(6), 1001-1022. https://doi.org/10.1007/s10763-019-10007-2
- Yukselturk, E., & Bulut, S. (2009). Gender differences in self-regulated online learning environment. Educational Technology & Society, 12(3), 12-22.
How to cite this article
APA
Samad, N. A., Osman, K., & Nayan, N. A. (2023). Learning chemistry through designing and its effectiveness towards inventive thinking. Eurasia Journal of Mathematics, Science and Technology Education, 19(12), em2374. https://doi.org/10.29333/ejmste/13883
Vancouver
Samad NA, Osman K, Nayan NA. Learning chemistry through designing and its effectiveness towards inventive thinking. EURASIA J Math Sci Tech Ed. 2023;19(12):em2374. https://doi.org/10.29333/ejmste/13883
AMA
Samad NA, Osman K, Nayan NA. Learning chemistry through designing and its effectiveness towards inventive thinking. EURASIA J Math Sci Tech Ed. 2023;19(12), em2374. https://doi.org/10.29333/ejmste/13883
Chicago
Samad, Norhaslinda Abdul, Kamisah Osman, and Nazrul Anuar Nayan. "Learning chemistry through designing and its effectiveness towards inventive thinking". Eurasia Journal of Mathematics, Science and Technology Education 2023 19 no. 12 (2023): em2374. https://doi.org/10.29333/ejmste/13883
Harvard
Samad, N. A., Osman, K., and Nayan, N. A. (2023). Learning chemistry through designing and its effectiveness towards inventive thinking. Eurasia Journal of Mathematics, Science and Technology Education, 19(12), em2374. https://doi.org/10.29333/ejmste/13883
MLA
Samad, Norhaslinda Abdul et al. "Learning chemistry through designing and its effectiveness towards inventive thinking". Eurasia Journal of Mathematics, Science and Technology Education, vol. 19, no. 12, 2023, em2374. https://doi.org/10.29333/ejmste/13883