Teacher Skills in Preparing Evaluation Instruments: Case Study of Teacher’s Understanding to Construct Hots Instrument

Risnita Risnita(1), Dedi Sastradika(2*), Salman Al Farisi(3)


(1) UIN Sulthan Thaha Saifuddin Jambi
(2) UIN Sulthan Thaha Saifuddin Jambi
(3) UIN Sulthan Thaha Saifuddin Jambi
(*) Corresponding Author

Abstract


Higher-order thinking Skills (HOTS) are 21st-century skills that must be facilitated in learning. However, currently, teachers are having problems understanding and designing HOTS skills instruments. This research aims to determine teachers' understanding in designing HOTS questions and determine the integrity of teachers' knowledge with instruments prepared by Social and Science subject teachers. This research is a mixed-method study with an Explanatory-Sequential Approach design. This research involved eight teachers with varied teaching experience. The results show that teachers lack understanding in preparing HOTS questions where the average achievement is 66.4% in every aspect of preparing HOTS questions. Analysis of the questions used by teachers shows that teachers still use questions at LOTS level (C1-C3). The interview results were coded using N-vivo, teachers had misconceptions about the development of HOTS questions and had different understandings in developing HOTS instruments. Future research can facilitate teachers to develop teachers' HOTS Instrument Preparation skills through training or workshops.

Keywords


HOTS; 21st Century Skills; 21st Century Learning; Teacher Understanding; Teacher Skills; ;

Full Text:

PDF

References


Ab Halim, A. S., Osman, K., Aziz, M. S. A. M., Ibrahim, M. F., & Ahmad, A. A. K. (2021). The Competency of Science Teachers in Integrating Higher Order Thinking Skills in Teaching and Learning. Journal of Physics: Conference Series, 1793(1). https://doi.org/10.1088/1742-6596/1793/1/012005

Abdullah, A. H., Mokhtar, M., Halim, N. D. A., Ali, D. F., Tahir, L. M., & Kohar, U. H. A. (2017). Mathematics teachers’ level of knowledge and practice on the implementation of higher-order thinking skills (HOTS). Eurasia Journal of Mathematics, Science and Technology Education, 13(1), 3–17. https://doi.org/10.12973/eurasia.2017.00601a

Afikah, A., Astuti, S. R. D., Suyanta, S., Jumadi, J., & Rohaeti, E. (2022). Mobile Learning in Science Education to Improve Higher-Order Thinking Skills (HOTS) and Communication Skills: A Systematic Review. International Journal of Advanced Computer Science and Applications, 13(7), 698–704. https://doi.org/10.14569/IJACSA.2022.0130782

Akbar, A. N., Irdiyansyah, I., & Suryanti, Y. (2022). High Order Thinking Skill (HOTS) In Interrogative Sentence Concept: The Teachers’ Challenges. Journal of English Language Teaching and Linguistics Studies, 4(2).

Alagan, T., Shanmugam, S. K. S., & Veloo, A. (2020). Tamil primary school teachers' understanding of constructing HOTS items in mathematics. Humanities and Social Sciences Letters, 8(2), 156–168. https://doi.org/10.18488/JOURNAL.73.2020.82.156.168

Alfarisy, I. H., Ainin, M., & Khasairi, M. (2023). Constructing Arabic Grammar Test Items Involving Higher-Order Thinking Skills; The Obstacles Against the Teachers. Journal of Higher Education Theory and Practice, 23(4), 147–154. https://doi.org/10.33423/jhetp.v23i4.5895

Azid, N., Ali, R. M., El Khuluqo, I., Purwanto, S. E., & Susanti, E. N. (2022). Higher order thinking skills, school-based assessment and students’ mathematics achievement: Understanding teachers’ thoughts. International Journal of Evaluation and Research in Education, 11(1), 290–302. https://doi.org/10.11591/ijere.v11i1.22030

Carroll, K. A., Harris, C. M., & Carroll, K. A. (2020). Using a Repetitive Instructional Intervention to Improve Students ’ Higher-Order Thinking Skills Using a Repetitive Instructional Intervention to Improve Students ’ Higher-Order Thinking Skills. College Teaching, 0(0), 1–9. https://doi.org/10.1080/87567555.2020.1823310

Dahlan, D. (2020). Teacher's competence and difficulties in constructing hot instruments in economics subject. Cakrawala Pendidikan, 39(1), 111–119. https://doi.org/10.21831/cp.v39i1.28869

Driana, E., & Ernawati. (2019). Teachers’ understanding and practices in assessing higher order thinking skills at primary schools. Aditya: Journal of Teaching & Education, 1(2), 620–628.

Edmonds, W, A., & D. Kennedy, T. (2017). An Applied Guide to Research Designs Quantitative, Qualitative, and Mixed Methods Second Edition. SAGE Publication, Inc.

Hujjatusnaini, N., Corebima, A. D., Prawiro, S. R., & Gofur, A. (2022). The Effect of Blended Project-Based Learning Integrated With 21st-Century Skills on Pre-Service Biology Teachers' Higher-Order Thinking Skills. Jurnal Pendidikan IPA Indonesia, 11(1), 104–118. https://doi.org/10.15294/jpii.v11i1.27148

Ibrahim, A., & Elfeky, M. (2018). The effect of personal learning environments on participants ' higher order thinking skills and satisfaction participants ' higher-order thinking skills and satisfaction. Innovations in Education and Teaching International, 00(00), 1–12. https://doi.org/10.1080/14703297.2018.1534601

Istiyono, E. (2018). IT-based HOTS assessment on physics learning as the 21st-century demand at senior high schools: Expectation and reality. AIP Conference Proceedings, 2014(September). https://doi.org/10.1063/1.5054418

Istiyono, E., Brams, W. S., Setiawan, R., & Megawati, I. (2019). Developing Computerized Adaptive Testing to Measure Physics Higher Order Thinking Skills of Senior High School Students and its Feasibility of Use. European Journal of Educational Research, 9(1), 91–101.

Jensen, J. L., McDaniel, M. A., Woodard, S. M., & Kummer, T. A. (2014). Teaching to the Test...or Testing to Teach: Exams Requiring Higher Order Thinking Skills Encourage Greater Conceptual Understanding. Educational Psychology Review, 26(2), 307–329. https://doi.org/10.1007/s10648-013-9248-9

Kementerian Pendidikan dan Kebudayaan. (2019). Modul Penyusunan Soal Keterampilah Berpikir TIngkat Tinggi (Higher Order Thinking Skills). In Direktorat Pembinaan SMA Direktorat Jenderal Pendidikan Dasar dan Menengah Kementerian Pendidikan dan Kebudayaan. Direktorat Pembinaan Sekolah Menengah Atas.

Kosasih, A., Supriyadi, T., Firmansyah, M. I., & Rahminawati, N. (2022). Higher-Order Thinking Skills in Primary School: Teachers’ Perceptions of Islamic Education. Journal of Ethnic and Cultural Studies, 9(1), 56–76. https://doi.org/10.29333/ejecs/994

Kwangmuang, P., Jarutkamolpong, S., Sangboonraung, W., & Daungtod, S. (2021). The development of learning innovation to enhance higher-order thinking skills for students in Thailand junior high schools. Heliyon, 7(February), e07309. https://doi.org/10.1016/j.heliyon.2021.e07309

Manassero-Mas, M. A., Moreno-Salvo, A., & Vázquez-Alonso, Á. (2022). Development of an instrument to assess young people’s attitudes toward critical thinking. Thinking Skills and Creativity, 45(April). https://doi.org/10.1016/j.tsc.2022.101100

Maxnun, L., Kristiani, K., & Sulistyaningrum, C. D. (2024). Development of hots-based cognitive assessment instruments: ADDIE model. Journal of Education and Learning, 18(2), 489–498. https://doi.org/10.11591/edulearn.v18i2.21079

Mitarlis, Ibnu, S., Rahayu, S., & Sutrisno. (2020). The effectiveness of new inquiry-based learning (NIBL) for improving multiple higher-order thinking skills (M-HOTS) of prospective chemistry teachers. European Journal of Educational Research, 9(3), 1309–1325. https://doi.org/10.12973/eu-jer.9.3.1309

Rampean, B. A. O., Rohaeti, E., & Utami, W. P. (2022). Teacher Difficulties for Developing Higher Order Thinking Skills Assessment Instrument on Reaction Rate. Jurnal Pendidikan Kimia Indonesia, 6(1), 11–19. https://doi.org/10.23887/jpk.v6i1.40898

Rosyadi, A. A. P., Sa'Dijah, C., Susiswo, & Rahardjo, S. (2022). High-order thinking skills: Can it arise when a prospective teacher solves a controversial mathematics problem? Journal of Physics: Conference Series, 2157(1). https://doi.org/10.1088/1742-6596/2157/1/012038

Saepuzaman, D., Retnawati, H., Istiyono, E., & Haryanto. (2020). Developing HOTS Instruments: Is It Difficult for Physics Teachers? Jurnal Pendidikan, 23(June), 1802–1826. https://www.researchgate.net/profile/Annalyn-

Canlas/publication/342500825_Model-

Based_Learning_Approach_Effects_on_Students’_Academic_Performance_and_Attitudes_in_Earth_science/links/6039e316299bf1cc26f426ef/Model-Based-Learning-Approach-Effects-on-Student

Setyarini, S. (2020). Teachers’ Understanding in Constructing Higher Order Thinking-Based Assessments: Voice from English Teachers’ Experience. 4th Asian Education Symposium (AES 2019), 438(Aes 2019), 39–42. https://doi.org/10.2991/assehr.k.200513.009

Suherman, Prananda, M. R., Proboningrum, D. I., Pratama, E. R., Laksono, P., & Amiruddin. (2020). Improving Higher Order Thinking Skills (HOTS) with Project Based Learning (PjBL) Model Assisted by Geogebra. Journal of Physics: Conference Series, 1467(1). https://doi.org/10.1088/1742-6596/1467/1/012027

Surjanti, J., Prakoso, A. F., Kurniawan, R. Y., Sakti, N. C., & Nurlaili, E. I. (2022). Development of High Order Thinking Skills in Indonesian Teachers. Obrazovanie i Nauka, 24(3), 104–125. https://doi.org/10.17853/1994-5639-2022-3-104-125

Suyatna, A., & Viyanti, U. R. (2020). Optimizing computer-based hots instruments: An analysis of test items, stimulus, and quiz setting based on physics teachers’ perceptions. Universal Journal of Educational Research, 8(3), 97–105. https://doi.org/10.13189/ujer.2020.081714

Tong, L. C., Rosli, M. S., & Saleh, N. S. (2022). Enhancing HOTS using Problem-Based Learning and Digital Games in the Context of Malaysian Primary School. International Journal of Interactive Mobile Technologies, 16(2), 101–112. https://doi.org/10.3991/ijim.v16i02.27677

Tyas, M. A., Nurkamto, J., Marmanto, S., & Laksani, H. (2019). Developing Higher Order Thinking Skills (HOTS) – Based Questions: Indonesian EFL Teachers’ Challenges. Proceeding of the International Conference on Future of Education, 2(1), 52–63. https://doi.org/10.17501/26307413.2019.2106

Wahono, B., Lin, P. L., & Chang, C. Y. (2020). Evidence of STEM enactment effectiveness in Asian student learning outcomes. International Journal of STEM Education, 7(1), 1–18. https://doi.org/10.1186/s40594-020-00236-1

Wilson, D. M., & Narasuman, S. (2020). Investigating teachers' implementation and strategies on higher order thinking skills in school-based assessment instruments. Asian Journal of University Education, 16(1), 70–84. https://doi.org/10.24191/ajue.v16i1.8991

Yunita, L., Nurjayadi, M., & Hariwibowo, H. (2021). Developing the Computer-Based Test ( CBT ) on the basic chemistry throughout a web-based application Developing the Computer-Based Test ( CBT ) throughout a web-based application. Journal of Physics: Conference Series PAPER, 10(1088), 1742–6596. https://doi.org/10.1088/1742-6596/1869/1/012026

Yusuf, I., Widyaningsih, S. W., & Sebayang, S. R. B. (2018). Implementation of E-learning based-STEM on quantum physics subject to student HOTS ability. Journal of Turkish Science Education, 15(Special Issue), 67–75. https://doi.org/10.12973/tused.10258a


Article Metrics

Abstract view : 87 times
PDF - 17 times

DOI: https://doi.org/10.26714/jps.12.1.2024.20-30

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 JURNAL PENDIDIKAN SAINS UNIVERSITAS MUHAMMADIYAH SEMARANG

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

EXECUTIVE OFFICE

JURNAL PENDIDIKAN SAINS UNIVERSITAS MUHAMMADIYAH SEMARANG
DEPARTMENT OF CHEMISTRY EDUCATION
FACULTY OF MATHEMATICS AND NATURAL SCIENCES
MUHAMMADIYAH SEMARANG UNIVERSITY

Jl. Kedungmundu Raya No.18, Semarang, Jawa Tengah, Indonesia
    Telp. (024)76740231, 76740231
    email: jps@unimus.ac.id


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License

Journal Pendidikan Saisn (JPS)
ISSN:2339-0786, e-ISSN:2502-1443
Published by: Chemistry Education, Muhammadiyah Semarang University