Assessing the Impact of ChatGPT and Google Gemini on University Students' Learning Outcomes: An Empirical Study at Institut Bakti Nusantara

Main Article Content

Nungsiyati Nungsiyati
Isahbela Isahbela
Eri Purwanti
Iis Maisaroh

Abstract

The integration of generative artificial intelligence (AI) into higher education offers opportunities to enhance learning effectiveness and academic engagement. However, empirical evidence connecting students’ acceptance of ChatGPT and Google Gemini with learning outcomes remains limited, particularly in Research Methodology courses. This study investigates technology acceptance, actual AI usage, and their relationships with students’ perceived learning outcomes at Institut Bakti Nusantara, Indonesia. A quantitative approach was employed involving 32 students selected from a population of 50. Data were collected using four-point Likert-scale questionnaires and analyzed through Partial Least Squares Structural Equation Modeling (PLS-SEM), Pearson correlation, and linear regression. The findings revealed positive relationships between perceived ease of use and behavioral intention (β = 0.480), perceived usefulness and behavioral intention (β = 0.350), and behavioral intention and actual use (β = 0.540). The model explained 55% of behavioral intention and 29% of actual usage variance. Furthermore, AI usage was positively associated with perceived learning outcomes (r = 0.672; R² = 0.452). The study’s novelty lies in integrating TAM-based acceptance pathways with learning-outcome assessment within a specific methodological learning context involving two generative AI platforms. These findings highlight the educational relevance of responsible AI integration while acknowledging limitations concerning sample size and causal inference

Article Details

Section
Articles

References

[1] E. Kasneci and others, “ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education,” Learn. Individ. Differ., vol. 103, p. 102274, 2023, doi: 10.1016/j.lindif.2023.102274.
[2] S. Chen and A. C. K. Cheung, “Effect of Generative Artificial Intelligence on University Students Learning Outcomes: A Systematic Review and Meta-Analysis,” Educ. Res. Rev., vol. 49, p. 100737, 2025, doi: 10.1016/j.edurev.2025.100737.
[3] R. Stroud and J. Du, “Student Acceptance of ChatGPT in Higher Education: A Mixed-Method Study of Attitudes, Intentions, and Concerns,” J. Appl. Learn. \& Teach., vol. 8, no. 2, pp. 35–48, 2025, doi: 10.37074/jalt.2025.8.2.7.
[4] L. Pham, T. Klaus, and J. Bateh, “Key Factors Influencing Intention to Use ChatGPT: An Empirical Study of U.S. Students,” Acta Psychol. (Amst)., vol. 260, p. 105516, 2025, doi: 10.1016/j.actpsy.2025.105516.
[5] P. Sun, L. Li, M. S. Hossain, and S. Zabin, “Investigating Students’ Behavioral Intention to Use ChatGPT for Educational Purposes,” Sustain. Futur., vol. 9, p. 100531, 2025, doi: 10.1016/j.sftr.2025.100531.
[6] V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis, “User Acceptance of Information Technology: Toward a Unified View,” MIS Q., vol. 27, no. 3, pp. 425–478, 2003, doi: 10.2307/30036540.
[7] C. Fauzi, Faurani Santi, Sanusi, Anuar, Jatiningrum, “Google Search Volume And Investor s ’ Decision On Return And Liquidity In Indonesia,” Opcion, vol. 35, no. 88, pp. 644–684, 2019.
[8] F. D. Davis, “Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology,” MIS Q., vol. 13, no. 3, pp. 319–340, 1989.
[9] Fauzi, “Modified TAM with Inducing the Reinforcement Institutional Theory (Facilitating Conditions, Institutional Enforcement and Insentive) toward SIPKD’s Individual Users Performance,” 2016.
[10] Fauzi, “TAM Modifikasian dengan Pengimbuhan Teori Penguatan Institusi ( Kondisi yang Memfasilitasi , Tekanan Institusi dan Insentif ) terhadap Kinerja Pengguna SIPKD Modified TAM,” Universitas Gadjah Mada, 2016. [Online]. Available: http://etd.repository.ugm.ac.id/index.php?act=view&buku_id=96135&mod=penelitian_detail&sub=PenelitianDetail&typ=html
[11] C. Fan, L. Ke, Z. Chen, and P. Lv, “Exploring the Effect of GenAI on Learning Outcomes in Higher Education: A Three-Level Meta-Analysis,” Front. Psychol., vol. 17, p. 1758670, 2026, doi: 10.3389/fpsyg.2026.1758670.