Analysis of Instrument Development Recount Text Writing Test HOTS for Vocational High School using Exploratory Factor Analysis (EFA)

Muhammad Haris Setiawan; Supriyadi Supriyadi; Dwi Anggani L. Bharati

doi:10.26858/est.v8i2.25910

Analysis of Instrument Development Recount Text Writing Test HOTS for Vocational High School using Exploratory Factor Analysis (EFA)

Muhammad Haris Setiawan⁽¹⁾, Supriyadi Supriyadi⁽²⁾, Dwi Anggani L. Bharati^(3*),

(1) Universitas Negeri Semarang
(2) Universitas Negeri Semarang
(3) Universitas Negeri Semarang
(*) Corresponding Author

DOI: https://doi.org/10.26858/est.v8i2.25910

Abstract

This study aims to determine the construct validity and reliability of the instrument recount text writing test HOTS in English subjects for vocational high school students. This method used a development research design from Djemari Mardapi which has been modified with the three steps. The analysis of construct validity instrument is based on how many factors are needed to explain the relationship between a set of indicators and is used the SPSS Statistic v24 application and reliability used Cronbach's Alpha. The sample in this study were 30 students with a quota sampling approach and were taken randomly. The results of the analysis construct validity with EFA got KMO values > 0.5, Anti Image Correlation > 0.5, Eigenvalue 1 and Factor Loading 0.3 and instrument reliability is 0.771. The results showed that overall, the items of instrument recount text writing test HOTS in English subjects for vocational high school students had good construct validity scores, all items were able to measure every cognitive ability and showed that the construct validity of each test item developed was good because of construct validity. Teachers need to use the development of this standard instrument to reduce the level of subjectivity of the assessment. Teachers should start using learning models and include HOTS questions to improve students' thinking skills.

Keywords

EFA, Writing Test, HOTS, Vocational High School

Full Text:

PDF

References

Anazifa, R. D., & Djukri, D. (2017). Project- Based Learning and Problem-Based Learning: Are They Effective to Improve Student’s Thinking Skills? Jurnal Pendidikan IPA Indonesia, 6(2), 346. https://doi.org/10.15294/jpii.v6i2.11100

Arafah, S. F., Ridlo, S., & Priyono, B. (2012). Pengembangan LKS Berpikir Kritis Pada mteri Animalia. Unnes Journal of Biology Education, 1(1), 47–53.

Arifin, Z. (2009). Evaluasi Instruktusional. Bandung: Remaja Karya.

Azwar, S. (2015). Penyusunan Skala Psikologi Edisi 2. Yogyakarta: Pustaka Belajar.

Azwar, S. (2016). Penyusunan Skala Psikologi Edisi 3. Yogyakarta: Pustaka Pelajar.

Barnett, J. E., & Francis, A. L. (2012). Using Higher Order Thinking Questions to Foster Critical Thinking: A Classroom Study. Educational Psychology, 32(2), 201–211. https://doi.org/10.1080/01443410.2011.638619

Darmadi, Hamid. (2010). Kemampuan Dasar Mengajar. Bandung: Alfabeta

Day, S. C., Norcini, J. J., Diserens, D., Cebul, R. D., Schwartz, J. S., Beck, L. H., … Elstein, A. (1990). The Validity of an Essay Test of Clinical Judgment. Academic Medicine, 65(9), S39-40.

Ellery, K. (2008). Assessment for Learning: A Case Study Using Feedback Effectively in an Essay-style Test. Assessment & Evaluation in Higher Education, 33(4), 421–429. https://doi.org/10.1080/02602930701562981

Faizah, U., Prastiwi, M. S., Subekti, N., Setyowati, D. L., Rachmadiarti, F., & Kuncjoro, S. (2015). Teaching Materials Model-based Problem Based Learning (PBL) to Habituate Students’ Conservation Awareness. In Procceding ICCBL 2015 (pp. 1–3). Semarang: International Conference on Conservation for Better Life.

Fuadi , Sumaryanto, T., & Lestari, W. (2014). Pengembangan Instrumen Penilaian Aspek Psikomotor Pembelajaran IPA Materi Tumbuhan Hijau Kelas V Berbasis Kompetensi Pendekatan Sea Berwawasan Konservasi. Innovative Journal of Curriculum and Educational Technology, 3(2). Retrieved from https://journal.unnes.ac.id/sju/index.php/ujet/article/view/9827

Gareis, R.C. (2007).”Reclaiming an Important Teacher Competency: The Lost Art of Formative Assessement”. J Pers Eval Educ. No. 20. Hal. 17–20

Ghozali, Imam. 2016. Aplikasi Analisis Multivariete Dengan Program IBM SPSS 23 (Edisi 8). Cetakan ke VIII. Semarang: Badan Penerbit Universitas Diponegoro.

Goodwin, S. (2016). A Many-Facet Rasch Analysis Comparing Essay Rater Behavior on an Academic English Reading/Writing Test used For Two Purposes. Assessing Writing, 30, 21–31. https://doi.org/10.1016/j.asw.2016.07.004

Handayani, R., & Priatmoko, S. (2012). Pengaruh Pembelajaran Problem Solving Berorientasi HOTS (Higher Order Thinking Skills) Terhadap Hasil Belajar Kimia Siswa Kelas X. Jurnal Inovasi Pendidikan Kimia UNNES, 6(2), 954–965. https://journal.unnes.ac.id/nju/index.php/JIPK/article/view/6532

Jailani, J., Sugiman, S., & Apino, E. (2017). Implementing the Problem-based Learning in Order to Improve the Students’ HOTS and Characters. Jurnal Riset Pendidikan Matematika, 4(2), 247. https://doi.org/10.21831/jrpm.v4i2.17674

Juhanda. (2016). Analisis Soal Jenjang Kognitif Taksonomi Bloom Revisi Pada Buku Sekolah Elektronik (BSE) Biologi SMA. Jurnal Pengajaran Matematika Dan Ilmu Pengetahuan Alam, 21(1).

Katoningsih, S., Soegito, A. T., Sumaryanto, T., & Susanto, M. (2018, September). The Implementation of Mobile Learning for Reading Literacy (Morlisa) for English Teacher training in Semarang. In International Conference on Science and Education and Technology 2018 (ISET 2018). Atlantis Press. https://doi.org/10.2991/iset-18.2018.95

Khumaedi, M (2012). Reliabilitas Instrumen Penilian Afektif Mata Pelajaran Aqidah Akhlak. Journal of Educaional Research and Evaluation, 3 (1), 37-40.

Krathwohl, D. R., & Anderson, L. W. (2010). Merlin C. Wittrock and the Revision of Bloom’s Taxonomy. Educational Psychologist, 45(1), 64–65. https://doi.org/10.1080/00461520903433562

Kusuma, M. D., Rosidin, U., Abdurrahman, A., & Suyatna, A. (2017). The Development of Higher Order Thinking Skill (HOTS) Instrument Assessment In Physics Study. IOSR Journal of Research & Method in Education (IOSRJRME), 07(01), 26–32. https://doi.org/10.9790/7388-0701052632

La Fave, L. (1966). Essay vs Multiple-choice: Which Test is Preferable? Psychology in the Schools, 3(1), 65–69. https://doi.org/10.1002/1520-6807(196601)3:1<65::AID-PITS2310030117>3.0.CO;2-Y

Mardapi, D. (2008). Teknik Penyusunan Instrumen Tes dan Nontes. Yogyakarta: Mitra Cendekia.

Mustaqima, Z. Z. (2018). Faktor-Faktor yang Mempengaruhi Pemilihan Moda Angkutan Umum Berbasis Online di Jakarta Selatan (Doctoral dissertation, Universitas Brawijaya).

Noviani, Y., Hartono, & Rusilowati, A. (2017). Analisis Pola Pikir Siswa Dalam Menyelesaikan Soal Sains Ditinjau dari Kemampuan Berpikir Kritis dan Kreatif Serta Literasi Sains. Journal of Innovative Science Education, 6(2), 147–154.

Pratiwiningtyas, B. N., Susilaningsih, E., & Sudaha, I. M. (2017). Pengembangan Instrumen Penilaian Kognitif untuk Mengukur Literasi Membaca Bahasa Indonesia Berbasis Model Pirls pada Siswa Kelas IV SD. Journal of Educational Research and Evaluation, 6(1), 1–9. https://doi.org/10.15294/jrer.v6i1.16199

Rahmawan, E. F., Sumaryanto, T., & Supriyadi, S. (2016). Pengembangan Instrumen Penilaian Kinerja Kemampuan Bernyanyi Berbasis Android. Journal of Educational Research and Evaluation, 5(1), 81-89. https://doi.org/10.15294/jrer.v5i1.14888

Ritdamaya, D., & Suhandi, A. (2016). Konstruksi Instrumen Tes Keterampilan Berpikir Kritis Terkait Materi Suhu dan Kalor. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 2(2), 87–96. https://doi.org/10.21009/1.02212

Rusilowati, A. (2014). Pengembangan Instrumen Penilaian. Semarang: UNNES PRESS

Rusilowati, A. (2017). Pengembangan Instrumen Penilaian. Semarang: Unnes Press.

Sasongko, P. (2010). Comparison of The Effectiviness of The Essay Test And Testlets Through The Graded Response Model (GRM) Application. Jurnal Penelitian Dan Evaluasi Pendidikan, 14(2) 1-9.

Suraji, Sumaryanto, T., & Khumaedi, M. (2019). The Analysis of Instrument of The Ability to Acting and Thinking Creatively Based Rasch Model, Journal of Educational Research and Evaluation, 8(10), 48–56. http://journal.unnes.ac.id/sju/index.php/jere

Sadtyadi, H., & Kartowagiran, B. (2014). Pengembangan Instrumen Penilaian Kinerja Guru Sekolah Dasar Berbasis Tugas Pokok dan Fungsi. Jurnal Penelitian dan Evaluasi Pendidikan, 18(2), 290-304. https://doi.org/10.21831/pep.v18i2.2867

Susanawati, E., Diantoro, M., & Yulianti, L. (2014). Pengaruh Strategi Projectbased Learning Dengan Thinkquest Terhadap Kemampuan Berpikir Kritis Fisika Siswa SMA Negeri 1 Kraksaan. Jurnal Pengajaran Matematika Dan Ilmu Pengetahuan Alam, 18(2), 207. https://doi.org/10.18269/jpmipa.v18i2.51

Susanto, E., & Retnawati, H. (2016). Perangkat pembelajaran matematika bercirikan PBL untuk mengembangkan HOTS siswa SMA. Jurnal Riset Pendidikan Matematika, 3(2), 189. https://doi.org/10.21831/jrpm.v3i2.10631

Suyata, P. (2006). Tes Bahasa Bentuk Uraian: Upaya ke Arah Kualitas Soal. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 2(2). https://doi.org/10.21831/cp.v2i2.9259

Therrien, W. J., Hughes, C., Kapelski, C., & Mokhtari, K. (2009). Effectiveness of a Test-Taking Strategy on Achievement in Essay Tests for Students With Learning Disabilities. Journal of Learning Disabilities, 42(1), 14–23.

Trisnawati, W., Citrasukmawati, A., & Thohir, M. A. (2017). Self Assessment For Student Performance Based on Higher Order Thinking Skills in Physics Learning. Journal of Education and Learning, 11(4), 446–452. https://doi.org/10.11591/edulearn.v11i4.6456

Widoyoko, E. P. (2016). Teknik Penyusunan Instrumen Penelitian. Yogyakarta: Pustaka Pelajar.

Weiss, R. E. (2003). Designing Problems to Promote Higher-order Thinking. New Directions for Teaching and Learning, 2003(95), 25–31. https://doi.org/10.1002/tl.109

Zaini, M. (2015). Hasil belajar dan keterampilan berpikir tingkat tinggi siswa SMA pada pembelajaran biologi menggunakan model pembelajaran berdasarkan masalah. Jurnal Pendidikan Biologi, 20(207), 34-43.

Zuhaida, A., Haryani, S., & Susilaningsih, E. (2014). Penyusunan Asesmen Metakognisi Calon Guru Kimia Melalui Pembelajaran Berbasis Masalah. Jurnal Pendidikan Sains, 2(1).

Peraturan Menteri Pendidikan dan Budaya Nasional Republik Indonesia Nomor 66 Tahun 2013 Tentang Standar Proses. bsnp-indonesia.org/id/wp.../2013/12/Permen-Nomor-66-Tahun-2013.pdf. (diunduh 19 November 2018)

Undang-Undang Nomor 20 Tahun 2003 tentang Sistem Pendidikan Nasional. Jakarta: Departemen Pendidikan Nasional.

Article Metrics

Abstract view : 161 times | PDF view : 0 times

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Editorial Office

Journal of Educational Science and Technology
Graduate Program Universitas Negeri Makassar

				Jl Bonto Langkasa Gunungsari Baru Makassar, 90222 Kampus PPs UNM Makassar Gedung AD Ruang 406 Lt 4, Indonesia
				jurnalestunm@gmail.com \| est.journal@unm.ac.id
				https://ojs.unm.ac.id/JEST/index
				085299898201 (WA)