EVALUASI DAN PENGEMBANGAN INSTRUMEN PENILAIAN KOMPETENSI TKJ DI SMKN 1 SAMBENG

Authors

  • Mohammad Wildan Habibi Universitas Negeri Surabaya
  • Yusuf Arif Rahman Universitas Negeri Surabaya
  • Briant Tedja Universitas Negeri Surabaya
  • Julio Anggara Putra Universitas Negeri Surabaya
  • Rafi Fernandika Putra Tweede Universitas Negeri Surabaya
  • Muhammad Zaky Ardiansyah Universitas Negeri Surabaya
  • Muh Yanuar Ismail Akbar Universitas Negeri Surabaya

DOI:

https://doi.org/10.51878/edutech.v6i2.10139

Keywords:

validitas konten, reliabilitas, instrumen penilaian, Aiken's V, Cronbach's Alpha

Abstract

 

Vocational competency assessment in vocational high schools (SMK) plays a strategic role in ensuring graduates' readiness to enter the workforce; however, the quality of assessment instruments used is often not scientifically standardized. Without systematic validation, assessment instruments risk producing biased competency data that cannot be scientifically justified, leading to inaccurate decisions regarding student graduation and certification. This issue becomes particularly critical in the context of SMK especially in the Computer and Network Engineering (TKJ) program as assessments are practice-based, involving complex rubrics that are highly susceptible to rater subjectivity. This study aims to evaluate the validity and reliability of the TKJ assessment instrument at SMKN 1 Sambeng and to design a new instrument based on the evaluation findings. A quantitative approach with an instrument validation design was employed through three phases: (1) content validation by five experts using Aiken's V, (2) empirical reliability testing on 30 students using Cronbach’s Alpha along with item-total correlation analysis as evidence of internal consistency significance, and (3) design and re-evaluation of the new instrument. The results indicate that the original instrument had content validity at the minimum threshold (CVI = 0.82), with six aspects falling below the V ≥ 0.75 cutoff, and inadequate reliability (α = 0.502). The newly designed instrument featuring balanced scoring weights (5 points per sub-aspect) and a three-level discrete descriptor system (0/3/5) demonstrated significant improvement: CVI = 0.94 and Cronbach’s Alpha = 0.844 (categorized as Very High), with all item-total correlations exceeding 0.65, indicating statistically strong internal consistency. This study carries practical implications for teachers and vocational schools: the validated instrument can be directly adopted as a fair and standardized reference for TKJ practical assessments, while simultaneously serving as a replicable validation procedure model applicable to other vocational programs within SMK.

ABSTRAK

Penilaian kompetensi kejuruan di SMK memegang peran strategis dalam menjamin kesiapan lulusan memasuki dunia kerja, namun kualitas instrumen yang digunakan kerap belum terstandarisasi secara ilmiah. Tanpa validasi sistematis, instrumen penilaian berisiko menghasilkan data kompetensi yang bias dan tidak dapat dipertanggungjawabkan, sehingga keputusan kelulusan maupun sertifikasi siswa menjadi tidak akurat. Konteks SMK khususnya program Teknik Komputer dan Jaringan (TKJ) menjadikan persoalan ini semakin krusial karena penilaian bersifat praktik dengan rubrik yang kompleks dan rentan terhadap subjektivitas penilai. Penelitian ini bertujuan mengevaluasi validitas dan reliabilitas instrumen penilaian TKJ di SMKN 1 Sambeng, serta merancang instrumen baru berdasarkan temuan evaluasi. Pendekatan kuantitatif dengan desain validasi instrumen digunakan melalui tiga fase: (1) validasi konten oleh lima ahli menggunakan Aiken's V, (2) uji reliabilitas empiris terhadap 30 siswa menggunakan Cronbach’s Alpha beserta uji korelasi item-total sebagai bukti signifikansi konsistensi internal, dan (3) perancangan serta evaluasi ulang instrumen baru. Hasil menunjukkan instrumen lama memiliki validitas konten di batas minimum (CVI = 0,82) dengan enam aspek di bawah ambang batas V ≥ 0,75, serta reliabilitas yang belum memadai (α = 0,502). Instrumen baru yang dirancang dengan bobot seimbang (5 poin per sub-aspek) dan deskriptor diskret tiga level (0/3/5) menghasilkan peningkatan signifikan: CVI = 0,94 dan Cronbach’s Alpha = 0,844 (kategori Sangat Tinggi), dengan seluruh korelasi item-total di atas 0,65 yang mengindikasikan konsistensi internal yang kuat secara statistik. Penelitian ini memberi implikasi praktis bagi guru dan sekolah kejuruan: instrumen tervalidasi dapat langsung diadopsi sebagai acuan penilaian praktik TKJ yang adil dan terstandar, sekaligus menjadi model prosedur validasi yang dapat direplikasi pada program keahlian lain di SMK.

Downloads

Download data is not yet available.

References

Aliffiansyah, A. N., Ekarini, F., & Djuniadi, D. (2025). Implementasi model Rasch pada analisis kualitas butir soal jaringan dasar pada jenjang pendidikan vokasi. Jurnal Metaedukasi: Jurnal Ilmiah Pendidikan, 7(2), 144–154. https://jurnal.unsil.ac.id/index.php/metaedukasi/article/view/17889/4671

Alizadeh, M., Shahsavari, H., & Matourypour, P. (2025). Key points in writing instrument development and psychometric evaluation reports. Revista Brasileira de Enfermagem, 78(4), e20250006. https://doi.org/10.1590/0034-7167-2025-0006

Bujang, M. A., Omar, E. D., & Baharum, N. A. (2018). A review on sample size determination for Cronbach’s alpha test: A simple guide for researchers. Malaysian Journal of Medical Sciences, 25(6), 85–99. https://doi.org/10.21315/mjms2018.25.6.9

De Ruiter, L. E., & Bers, M. U. (2021). The coding stages assessment: Development and validation of an instrument for assessing young children’s proficiency in the ScratchJr programming language. Computer Science Education, 32(4), 388–417. https://doi.org/10.1080/08993408.2021.1956216

Ghozali, I. (2018). Aplikasi analisis multivariate dengan program IBM SPSS 25. Badan Penerbit Universitas Diponegoro.

Hakim, D. R., & Kurniawati, D. (2022). The effect of competency and ICT skills on vocational students’ work readiness. Jurnal Pendidikan Ekonomi dan Bisnis (JPEB), 10(1), 15–34. https://doi.org/10.21009/jpeb.010.1.2

Juliani, R. P., & Erita, S. (2023). Analisis validitas dan reliabilitas instrumen penilaian kemampuan berpikir kritis dalam konteks sekolah menengah. JEID: Journal of Educational Integration and Development, 3(3), 169–179. https://doi.org/10.55868/jeid.v3i3.313

Khotimah, H., & Hidayat, N. (2024). Evaluasi pembelajaran: Konsep, model, dan pengembangan tes hasil belajar. Penerbit Litnus.

Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

Nurjanah, S., Istiyono, E., Widihastuti, Y., Iqbal, M., & Kamal, S. (2023). The application of Aiken’s V method for evaluating the content validity of instruments that measure the implementation of formative assessments. Journal of Research and Educational Research Evaluation, 12(2), 125–133. https://doi.org/10.15294/jere.v12i2.76451

Rahmah, S., & Festiyed. (2025). The validity of online assessment instruments for measuring higher order thinking skills of high school students in physics subject. Jurnal Penelitian Pendidikan IPA, 11(2), 92–98. https://doi.org/10.29303/jppipa.v11i2.4993

Roebianto, A., Savitri, S. I., Aulia, I., Suciyana, A., & Mubarokah, L. (2023). Content validity: Definition and procedure of content validation in psychological research. Testing, Psychometrics, Methodology in Applied Psychology, 30, 5–18. https://doi.org/10.4473/TPM30.1.1

Rohman, S. (2023). Pengembangan instrumen penilaian hasil belajar berbasis taksonomi Bloom. Al-Ibrah: Jurnal Pendidikan dan Keilmuan Islam, 8(1), 86–108. https://doi.org/10.61815/alibrah.v8i1.262

Saryadi, S., Listyorini, P. I., Arini, L. D. D., & Pattinama, A. M. (2025). Uji validitas dan reliabilitas pengukuran kepuasan pengguna RME dengan metode EUCS. Jurnal Riset Rumpun Ilmu Kesehatan, 4(2), 44–59. https://doi.org/10.55606/jurrikes.v4i2.5255

Shuaili, A. S. T. A. (2025). Bridging the skills gap: Technical and vocational education and training student competencies and labor market alignment in Oman. Vocation Technology & Education, 2(3). https://doi.org/10.54844/vte.2025.0991

Subando, J. (2022). Validitas dan reliabilitas instrumen non tes. Penerbit Lakeisha.

Sudira, P. (2021). Pendidikan vokasi abad 21: Inovasi, relevansi, dan tantangan. UNY Press.

Viberg, O., Pargman, T. C., & Lilliesköld, J. (2024). Exploring teachers' (future) digital assessment practices in higher education: Instrument and model development. British Journal of Educational Technology, 55, 2597–2616. https://doi.org/10.1111/bjet.13462

Villarroel, V., Melipillán, R., Santana, J., & Aguirre, D. (2024). How authentic are assessments in vocational education? An analysis from Chilean teachers, students, and examinations. Frontiers in Education, 9, 1–12. https://doi.org/10.3389/feduc.2024.1308688

Yusop, S. R. M., Rasul, M. S., Yasin, R. M., & Hashim, H. U. (2022). Assessment approaches and learning outcomes in technical and vocational education: A systematic review using PRISMA. Sustainability, 14(9), 5225. https://doi.org/10.3390/su14095225

Yusop, S. R. M., Rasul, M. S., Yasin, R. M., & Hashim, H. U. (2023). Identifying and validating vocational skills domains and indicators in classroom assessment practices in TVET. Sustainability, 15(6), 5195. https://doi.org/10.3390/su15065195

Downloads

Published

2026-05-11

How to Cite

Habibi, M. W., Rahman, Y. A., Tedja, B., Putra, J. A., Tweede, R. F. P., Ardiansyah, M. Z., & Akbar, M. Y. I. (2026). EVALUASI DAN PENGEMBANGAN INSTRUMEN PENILAIAN KOMPETENSI TKJ DI SMKN 1 SAMBENG . EDUTECH : Jurnal Inovasi Pendidikan Berbantuan Teknologi, 6(2), 735–747. https://doi.org/10.51878/edutech.v6i2.10139

Issue

Section

Articles