Designing a Geometry Examination Framework to Evaluate Higher-Order Thinking Skills
Main Article Content
Abstract
This study aims to develop a valid, practical, and effective instrument for assessing higher-order thinking skills (HOTS) in junior high school mathematics. Employing a research and development (R&D) approach, the study adapts Mardapi's (2008) development model, which includes nine stages. However, this research focuses on the first seven stages, leaving the final implementation to teachers in schools. The instrument was tested on 40 students at SMPN 2 Rajagaluh, Majalengka Regency. The validity analysis demonstrated that all V values exceeded 0.3, indicating strong content validity. Reliability testing yielded a Cronbach's Alpha score of 0.52, suggesting moderate internal consistency. The findings revealed that students' HOTS performance remains suboptimal, highlighting the need for targeted instructional strategies. Strengthening HOTS can be achieved through structured practice with complex problem-solving tasks. This study provides a robust framework for educators to assess and enhance students’ critical thinking abilities in mathematics.
Article Details
References
A’yun, Q., Yanuarti, R. S., & Cahyo, D. A. (2021). Performance Analysis of Students Through Critical Thinking Ability Based on Mathematic Ability. Malikussaleh Journal of Mathematics Learning (MJML), 4(1), 23–27. https://doi.org/10.4108/eai.19-12-2020.2309168
Abdurrahman, M. S. (2021). Improving polytechnic students’ high-order-thinking-skills through inquiry-based learning in mathematics classroom. International Journal of Evaluation and Research in Education, 10(3), 976–983. https://doi.org/10.11591/IJERE.V10I3.21771
Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement.
Ansari, B. I., Saleh, M., Nurhaidah, & Taufiq. (2021). Exploring students’ learning strategies and self-regulated learning in solving mathematical higher-order thinking problems. European Journal of Educational Research, 10(2), 743–756. https://doi.org/10.12973/eu-jer.10.2.743
Arifin, Z., & Bonyah, E. (2024). Tracing the Roots of Error: A Polya Method Analysis on Student Problem Solving in Curved Surface Solids. International Journal of Geometry Research and Inventions in Education (Gradient), 1(01), 21–30. https://doi.org/10.56855/gradient.v1i01.1144
Asari, S., Husniah, R., Ma’rifah, U., & Anwar, K. (2019). Fostering Students’ High Order Thinking Skills through the Use of Interpretation Cards. International Journal of Education and Literacy Studies, 7(4), 17. https://doi.org/10.7575/aiac.ijels.v.7n.4p.17
Aulya, N. R., Ichsan, I. Z., & Rahman, M. (2020). HOTS Analysis to Develop E-Supplement Book Based on Plant Physiology Research. Universal Journal of Educational Research, 8(12B), 8461–8466. https://doi.org/10.13189/ujer.2020.082654
Basuki, I., & Hariyanto. (2014). Asesemen pembelajaran. PT. Remaja Rosdakarya.
Bayram, S. (2021). World journal on educational technology: Current issues. World Journal on Educational Technology: Current Issues, 13(4), 82–95. https://doi.org/https://doi.org/10.18844/wjet.v13i1.5401
Bertucio, B. (2017). The Cartesian Heritage of Bloom’s Taxonomy. Studies in Philosophy and Education, 36(4), 477–497. https://doi.org/10.1007/s11217-017-9575-2
Chandio, M. T., Nishat Zafar, & Solangi, G. M. (2021). Bloom’s Taxonomy: Reforming Pedagogy Through Assessment. Journal of Education and Educational Development, 8(1), 109–140. https://doi.org/10.22555/joeed.v8i1.308
Collins, R. (2014). Skills for the 21st Century: teaching higher-order thinking. Curriculum & Leadership Journal, 12(14). http://www.curriculum.edu.au/leader/teaching_higher_order_thinking,37431.html?issueID=12910
Conklin, W. (2012). Strategies for Developing Higher-Order Thinking Skills, Grades 6-12: Grades 6-12. Shell Educational Publishing.Inc.
Friyatmi, F., Mardapi, D., & Haryanto, H. (2020). Assessing Students’ Higher Order Thinking Skills Using Multidimensional Item Response Theory. Problems of Education in the 21st Century, 78(2), 196–214. https://doi.org/10.33225/pec/20.78.196
Gavronskaya, Y., Larchenkova, L., Berestova, A., Latysheva, V., & Smirnov, S. (2022). The Development of Critical Thinking Skills in Mobile Learning: Fact-Checking and Getting Rid of Cognitive Distortions. International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 10(2), 51–68. https://doi.org/10.23947/2334-8496-2022-10-2-51-68
Haniah, A. R., Aman., & Setiawan, R. (2020). Integration of strengthening of character education and higher order thinking skills in history learning. Journal of Education and Learning (EduLearn), 14(2), 183–190. https://doi.org/10.11591/edulearn.v14i2.15010
Harta, J., Rasuh, N. T., & Seriang, A. (2020). Using HOTS-Based Chemistry National Exam Questions to Map the Analytical Abilities of Senior High School Students. Journal of Science Learning, 3(3), 143–148. https://doi.org/10.17509/jsl.v3i3.22387
Heryani, Y., Kartono, Wijayanti, K., & Dewi, N. R. (2023). Analysis of Student’s Mathematical Literacy Ability in Solving HOTS Problems in Minimum Competency Assessment. Journal of Higher Education Theory and Practice, 23(16). https://doi.org/10.33423/jhetp.v23i16.6470
Indriyana, B. S., & Kuswandono, P. (2019). Developing Students Higher Order Thinking Skills (HOTS) in Reading: English Teachers Strategies in Selected Junior High Schools. JET (Journal of English Teaching), 5(3), 204. https://doi.org/10.33541/jet.v5i3.1313
Jasmina, A., Alla, B., Yulia, T., Grosseck, G., & Živkov, A. M. (2022). The Quality of Online Higher Education Teaching During the Covid-19 Pandemic. International Journal of Cognitive Research in Science, Engineering and Education, 10(1), 47–55. https://doi.org/10.23947/2334-8496-2022-10-1-47-55
Kania, N., & Kusumah, Y. S. (2025). THE MEASUREMENT OF HIGHER-ORDER THINKING SKILLS: A SYSTEMATIC LITERATURE REVIEW. Malaysian Journal of Learning and Instruction, 22(1), 97–116. https://doi.org/10.32890/mjli2025.22.1.6
Kania, N., Kusumah, Y. S., Dahlan, J. A., Nurlaelah, E., & Kyaruzi, F. (2024). Decoding Student Struggles in Geometry: Newman Error Analysis of Higher-Order Thinking Skills. International Journal of Geometry Research and Inventions in Education (Gradient), 1(01), 31–47. https://doi.org/10.56855/gradient.v1i01.1146
Kania, N., Nurhikmayati, I., & Suciawati, V. (2020). Pre-service mathematics teachers’ experiences of teaching practice in function composition. Journal of Physics: Conference Series, 1613(1). https://doi.org/10.1088/1742-6596/1613/1/012013
Kania, N., Suryadi, D., Kusumah, Y. S., Dahlan, J. A., Nurlaelah, E., & Elsayed, E. E. (2024). Comparative Praxeology: Assessing High-Level Cognitive Skills in TIMSS and Indonesian National Examinations. International Journal of Applied Learning and Research in Algebra, 1(1), 25–47. https://doi.org/10.56855/algebra.v1i1.1160
Kemendikbud. (2019). Tingkat Kesulitan Soal UN 2019 Tidak Berubah, Ini Komposisi Soalnya. https://www.kemdikbud.go.id
Kim, H. J. (2020). Students’ academic use of mobile technology and higher-order thinking skills: The role of active engagement. Education Sciences, 10(3). https://doi.org/10.3390/educsci10030047
Kullan, S., Mansor, M., & Ishak, R. (2022). The validity and reliability of an instrument to evaluate the practices of learning organization. International Journal of Evaluation and Research in Education (IJERE), 11(4), 1725. https://doi.org/10.11591/ijere.v11i4.22974
Kurniawan, H., Budiyono, Sajidan, & Siswandari. (2021). The PINTER learning model to enhance higher order thinking and communication skill in Algebra. International Journal of Instruction, 14(3), 359–374. https://doi.org/10.29333/iji.2021.14321a
Mardapi, D. (2008). Technique of preparation of test and non test instrument. Mitra Cendekia Press.
Maryani, I., Prasetyo, Z. K., Wilujeng, I., & Purwanti, S. (2022). Promoting higher-order thinking skills during online learning: The integration of metacognition in science for higher education. International Journal of Evaluation and Research in Education (IJERE), 11(4), 1980. https://doi.org/10.11591/ijere.v11i4.23129
Mitani, H. (2021). Test Score Gaps in Higher Order Thinking Skills : Exploring Instructional Practices to Improve the Skills and Narrow the Gaps. AERA Open, 7(1). https://doi.org/10.1177/23328584211016470
Mulyatna, F., Imswatama, A., & Rahmawati, N. D. (2021). Design Ethnic-Math HOTS: Mathematics Higher Order Thinking Skill Questions Based On Culture and Local Wisdom. Malikussaleh Journal of Mathematics Learning (MJML), 4(1), 48. https://doi.org/10.29103/mjml.v4i1.3059
Musfiqi, A., & Jailani. (2014). Pengembangan Bahan Ajar Matematika yang Berorientasi pada Karakter dan Higher Order Thinking Skill (HOTS) Developing Mathematics Instructional Materials Oriented to Character and Higher Order Thinking Skill (Hots). PYTHAGORAS: Jurnal Pendidikan Matematika, 9(1), 45–59. http://journal.uny.ac.id/index.php/pythagoras
Nitko, A. J., & Brookhart, S. M. (2011). Educational assessment of students (Xth editio). Prentice Hall Englewood Cliffs.
Pi’i. (2016). Developing High-Level Thinking Learning and Assessment in High School History Subjects (in bahasa),". Jurnal Sejarah Dan Budaya,.
Putranta, H., Supahar, Setiyatna, H., Choiriyah, S., Dwandaru, W. S. B., Widodo, & Warsono. (2021). The Effect of Smartphone Usage Intensity on High School Students’ Higher Order Thinking Skills in Physics Learning. Journal of Turkish Science Education, 18(3), 421–438. https://doi.org/10.36681/tused.2021.82
Radmehr, F., & Drake, M. (2019). Revised Bloom’s taxonomy and major theories and frameworks that influence the teaching, learning, and assessment of mathematics: a comparison. International Journal of Mathematical Education in Science and Technology, 50(6), 895–920. https://doi.org/10.1080/0020739X.2018.1549336
Rahman, N. A., Rosli, R., Rambely, A. S., & Halim, L. (2021). Mathematics teachers’ practices of stem education: A systematic literature review. European Journal of Educational Research, 10(3), 1541–1559. https://doi.org/10.12973/EU-JER.10.3.1541
Rahmi, Y. L., Habibah, I. N., Zulyusri, Z., & Darussyamsu, R. (2021). HOTS assessment in circulatory system learning: Validity, reliability, and item quality. JPBI (Jurnal Pendidikan Biologi Indonesia), 7(2), 171–178. https://doi.org/10.22219/jpbi.v7i2.15513
Ramdiah, S., Abidinsyah, Royani, M., & Husamah. (2019). Understanding, planning, and implementation of HOTS by senior high school biology teachers in Banjarmasin-Indonesia. International Journal of Instruction, 12(1), 425–440. https://doi.org/10.29333/iji.2019.12128a
Ratnawulan, N., & Kania, N. (2020). Implementation of Cooperative Learning Model Numbered Head Together ( Nht ) Type To Improve Learning Activities. Jurnal THEOREMS (The Original Research of Mathematics), 4(2), 161–168.
Riadi, A., & Retnawati, H. (2014). Pengembangan Perangkat Pembelajaran untuk Meningkatkan HOTS pada Kompetensi Bangun Ruang Sisi Datar Developing Learning Kit to Improve HOTS for Flat Side of Space Competence. PYTHAGORAS: Jurnal Pendidikan Matematika, 9(2), 126–135. http://journal.uny.ac.id/index.php/pythagoras
Sadijah, C., Murtafiah, W., Anwar, L., Nurhakiki, R., & Cahyowati, E. T. D. (2021). Teaching higher-order thinking skills in mathematics classrooms: Gender differences. Journal on Mathematics Education, 12(1), 159–179. https://doi.org/10.22342/jme.12.1.13087.159-180
Samo, D. D., Garak, S. S., & Maifa, T. S. (2020). Mathematics teacher knowledge in higher-order thinking skill: curriculum, pedagogy, and assessment. In Journal of Physics: Conference Series (Vol. 1663, p. 12012). IOP Publishing. https://doi.org/10.1088/1742-6596/1663/1/012012
Samo, D. D., & Kartasasmita, B. (2017). Developing Contextual Mathematical Thinking Learning Model to Enhance Higher-Order Thinking Ability for Middle School Students. 10(12), 17–29. https://doi.org/10.5539/ies.v10n12p17
Santoso, S. (2006). Seri Solusi Bisnis Berbasis TI: Menggunakan SPSS untuk Statistik Multivariat. Elex Media Komputindo.
Schoenfeld, A. (2010). How We Think. University of California-Berkeley.
Setiawan, J., Sudrajat, A. A., Aman, A., & Kumalasari, D. (2021). Development of higher order thinking skill assessment instruments in learning Indonesian history. In International Journal of Evaluation and Research in Education (IJERE) (Vol. 10, Issue 2, p. 545). Institute of Advanced Engineering and Science. https://doi.org/10.11591/ijere.v10i2.20796
Simsek, Z. Z. (2021). “Is It Valid or Not?”: Pre-Service Teachers Judge the Validity of Mathematical Statements and Student Arguments. European Journal of Science and Mathematics Education, 9(2), 26–42. https://doi.org/10.30935/SCIMATH/10772
Spindler, R. (2020). Aligning Modeling Projects with Bloom’s Taxonomy. Primus, 30(5), 601–616. https://doi.org/10.1080/10511970.2019.1619208
Sujoko, E., & Darmawan, I. P. A. (2013). REVISI TAKSONOMI PEMBELAJARAN BENYAMIN S. BLOOM I Putu Ayub Darmawan. Jurnal Satya Widya, 29(1), 30–39.
Surapranata, S. (2009). Analisis, validitas, reliabilitas, dan interpretasihasil tes implementasi kurikulum 2004. PT. Remaja Rosdakarya.
Syafryadin, Harahap, A., Haryani, & Astrid, A. (2021). Boosting classroom interaction based on higher order thinking skills (Hots) in english learning for beginners. International Journal of Language Education, 5(1), 477–489. https://doi.org/10.26858/IJOLE.V5I1.15211
Tambunan, H., & Naibaho, T. (2019). Performance of mathematics teachers to build students’ high order thinking skills (HOTS). Journal of Education and Learning (EduLearn), 13(1), 111–117. https://doi.org/10.11591/edulearn.v13i1.11218
Taştan, M., & Yilmaz, K. (2008). Organizational citizenship and organizational justice scales’ adaptation to turkish. Egitim ve Bilim, 33(150), 87–96.
Tyas, M. A., Nurkamto, J., & Marmanto, S. (2020). Cultivating Students ’ Higher -Order Thinking Skills in EFL Classes : The Role of The Teacher and The Textbook. International Online Journal of Education and Teaching (IOJET), 7(1), 267–276. http://iojet.org/index.php/IOJET/article/view/773
Yaniawati, P., Maat, S. M., Supianti, I. I., & Fisher, D. (2021). Mathematics Mobile Blended Learning Development: Student-Oriented High Order Thinking Skill Learning. European Journal of Educational Research, 11(1), 69–81. https://doi.org/https://doi.org/10.12973/eu-jer.11.1.69