VALIDITY AND RELIABILITY OF THE NEW STUDENT ADMISSION SYSTEM QUALITY QUESTIONNAIRE IN POSTGRADUATE PROGRAMS
DOI:
https://doi.org/10.38048/jipcb.v13i1.6611Keywords:
student admission system, system quality, questionnaire validation, Cronbach’s alpha, student satisfaction, intention to enrollAbstract
This study aims to evaluate the quality of new student admission services and develop a reliable and valid questionnaire to measure four key constructs: admission system quality, intention to apply, prospective student satisfaction, and initial academic service effectiveness. Instruments used in this context often lack psychometric evidence, raising concerns about their reliability and accuracy. The questionnaire was developed through item generation based on theoretical reviews, expert validation, and a pilot test involving 34 postgraduate prospective students. Validity was assessed using Corrected Item–Total Correlation with reference to critical r values, while reliability was evaluated with Cronbach’s Alpha, which showed a very high internal consistency (? = 0.992). These results confirm strong preliminary validity and reliability. Further validation through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) is planned for future studies with larger and more diverse samples to assess the instrument's factorial structure and model fit. The pilot test revealed that all 88 items exceeded the critical r threshold, confirming preliminary validity. However, the sample size and context limit generalizability, and future research should involve larger and more varied samples, as well as cross-institutional testing, to strengthen construct stability. This instrument can be effectively used for data-driven evaluation and quality improvement of student admission services in higher education institutions. It provides administrators with a reliable tool to enhance admission service delivery.
References
Acharya, K. (2025). Student exam satisfaction: Examining the impact of registration, communication, center’s infrastructure, and exam center management. International Journal of Humanities, Education, and Social Sciences, 3(2). https://doi.org/10.58578/ijhess.v3i2.6041
Alam, F., & Harya, G. (2025). The evaluation of user interface and user experience in the new student admission system. Information Technology International Journal, 3(1). https://doi.org/10.33005/itij.v3i1.41
Alexandre, N., & Coluci, M. (2011). Content validity in the development and adaptation processes of measurement instruments. Ciência & Saúde Coletiva, 16(7), 3061–3068. https://doi.org/10.1590/S1413-81232011000800006
Alfiyah, N., Chalisah, N., & Zuhriyah, I. (2025). Validity and reliability of instruments: Students’ perception of Google Classroom and interest in learning Islamic religion. JISAE: Journal of Indonesian Student Assessment and Evaluation, 11(1). https://doi.org/10.21009/jisae.v11i1.52521
Almanasreh, E., Moles, R., & Chen, T. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Amalia, N., & Zuraidah, E. (2022). Analisa kualitas layanan web pendaftaran online pada MI Satria menggunakan metode SERVQUAL. Resolusi: Rekayasa Teknik Informatika dan Informasi, 2(6). https://doi.org/10.30865/resolusi.v2i6.420
Bunawolo, I., Budiyantara, A., Mahasiswa, K., Pelayanan, K., & Layanan, M. (2024). Analisis kepuasan mutu pelayanan PMB STISIP Widuri menggunakan metode service quality (SERVQUAL). Merkurius: Jurnal Riset Sistem Informasi dan Teknik Informatika, 2(6). https://doi.org/10.61132/merkurius.v2i6.432
Camacho-Tamayo, E., & Bernal-Ballén, A. (2023). Validation of an instrument to measure natural science teachers’ self-perception about implementing STEAM approach in pedagogical practices. Education Sciences, 13(8), 764. https://doi.org/10.3390/educsci13080764
Del Carmen Olmos-Gómez, M., Luque-Suárez, M., Castán-García, M., & Portillo-Sánchez, R. (2023). Validation of educational quality as a tool to measure the degree of satisfaction of university students. Education Sciences, 14(1), 2. https://doi.org/10.3390/educsci14010002
Fernández-Gómez, E., Martín-Salvador, A., Luque-Vara, T., Sánchez-Ojeda, M., Navarro-Prado, S., & Enrique-Mirón, C. (2020). Content validation through expert judgement of an instrument on nutritional knowledge, beliefs, and habits of pregnant women. Nutrients, 12(4), 1136. https://doi.org/10.3390/nu12041136
Gonzales, A., Fernandez, R., Pinto, S., Del Carmen Barriga Garcia, M., & Allison, C. (2025). Validation of the instrument for the evaluation of satisfaction with the quality of educational services. Universidad Ciencia y Tecnología, 29(126). https://doi.org/10.47460/uct.v29i126.882
Hamonangan, S. (2023). Analisis kualitas pelayanan di bagian penerimaan siswa baru menggunakan metode service quality pada SMK Wiyata Satya. Jurnal Publikasi Sistem Informasi dan Manajemen Bisnis, 3(1). https://doi.org/10.55606/jupsim.v3i1.2395
Hoang, T., Bui, T., Phan, H., Nguyen, T., & Van Hoang, L. (2023). Examining nursing students’ perceptions of educational environment: Further validation of DREEM instrument. T?p chí Khoa h?c ?i?u d??ng. https://doi.org/10.54436/jns.2024.01.675
Huang, Y., Huang, M., Wang, H., Chen, Z., & Liu, X. (2023). Do college entrance examination admission characteristics influence students’ college satisfaction? Evidence from China. Frontiers in Psychology, 14, 1115867. https://doi.org/10.3389/fpsyg.2023.1115867
Kanwar, A., & Sanjeeva, M. (2022). Student satisfaction survey: A key for quality improvement in higher education institutions. Journal of Innovation and Entrepreneurship, 11, 10. https://doi.org/10.1186/s13731-022-00196-6
Mahmoudi, G., & Jouybari, L. (2025). Psychometric validation of the student perception of virtual education quality (SPGP) questionnaire in medical education. BMC Medical Education, 25, 80. https://doi.org/10.1186/s12909-025-08056-z
Martin, F., Stamper, B., & Flowers, C. (2020). Examining student perception of readiness for online learning: Importance and confidence. Online Learning Journal, 24(2), 38–58. https://doi.org/10.24059/olj.v24i2.2053
Mokkink, L., Herbelet, S., Tuinman, P., & Terwee, C. (2025). Content validity: Judging the relevance, comprehensiveness and comprehensibility of an outcome measurement instrument—A COSMIN perspective. Journal of Clinical Epidemiology, 111879. https://doi.org/10.1016/j.jclinepi.2025.111879
Mousavi, A., Mohammadi, A., Mojtahedzadeh, R., Shirazi, M., & Rashidi, H. (2020). E-learning educational atmosphere measure (EEAM): A new instrument for assessing e-students’ perception of educational environment. Research in Learning Technology, 28. https://doi.org/10.25304/rlt.v28.2308
Noor, L., & Tanzil, F. (2020). The effect of service quality education academic and facilities on student satisfaction. International Journal of Economics, Business and Accounting Research, 4(2). https://doi.org/10.29040/ijebar.v4i02.1047
Polit, D., Beck, C., & Owen, S. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Pratiwi, N., Purwati, A., Hamzah, M., & Nyoto, N. (2022). The effect of service quality and academic information systems quality on student satisfaction. International Journal of Economics Development Research, 3(1). https://doi.org/10.37385/ijedr.v3i1.400
Rasheed, R., & Rashid, A. (2023). Role of service quality factors in word of mouth through student satisfaction. Kybernetes, 53(9), 2854–2870. https://doi.org/10.1108/K-01-2023-0119
Sugandi, S., Kulkarni, S., Mulyana, A., Haedari, A., & Casta, C. (2025). From selection to success: Assessing the impact of student admissions strategies on the quality of education. Al-Tanzim: Jurnal Manajemen Pendidikan Islam, 9(1). https://doi.org/10.33650/al-tanzim.v9i1.9096
Taber, K. (2017). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Terwee, C., Prinsen, C., Chiarotto, A., Westerman, M., Badawy, D., Alonso, J., Bouter, L., De Vet, H., & Mokkink, L. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
Thalib, S., Thalib, T., Mustafa, M., & Musawwir, M. (2022). Zonasi system in admission of new students and its impact on students’ psychological condition. Klasikal: Journal of Education, Language Teaching and Science, 4(1). https://doi.org/10.52208/klasikal.v4i1.126
Uska, M., Wirasasmita, R., & Fahrurrozi, M. (2020). The application of usability testing method for evaluating the new student acceptance system. Journal of Physics: Conference Series, 1539, 012028. https://doi.org/10.1088/1742-6596/1539/1/012028
Van Der Scheer, E., Bijlsma, H., & Glas, C. (2018). Validity and reliability of student perceptions of teaching quality in primary education. School Effectiveness and School Improvement, 30(1), 30–50. https://doi.org/10.1080/09243453.2018.1539015
Yaw, O., & Agani, H. (2023). Developing and validating an instrument to measure students’ experiences in a further mathematics classroom. E-Journal of Humanities, Arts and Social Sciences. https://doi.org/10.38159/ehass.20234535
Yüksel, S., Demir, P., Alkan, A., Saatçio?lu, M., & Koordinatörlü?ü, A. (2023). Evaluation of the psychometric properties of scales to measure student satisfaction used as an indicator of service quality in higher education in Turkey. Yüksekö?retim Dergisi, 13(1). https://doi.org/10.53478/yuksekogretim.1252205
Yusoff, M. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2). https://doi.org/10.21315/eimj2019.11.2.6
Zhuang, H., Zhao, H., Wang, Y., He, C., Zhai, J., & Wang, B. (2025). Development and validation of a school satisfaction scale for medical students. BMC Medical Education, 25, 696. https://doi.org/10.1186/s12909-025-06962-w
Zulvi, M., Najwa, N., & Ningsih, N. (2025). Implementation and evaluation of user-centered design in an online new student admissions system for early childhood education. Journal of Applied Informatics and Computing, 9(2). https://doi.org/10.30871/jaic.v9i2.8735
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Jurnal Ilmiah Pendidikan Citra Bakti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
