Open Access Peer-reviewed Research Article

Exploring user perceptions: The impact of ChatGPT on high school students' physics understanding and learning

Article Sidebar

ANOVA test results
Download PDF
Submitted   Sep 13, 2024
Published   Dec 4, 2024
Issue    Vol 4 No 2 (2024)
DOI   10.25082/AMLER.2024.02.013

Views

304

Downloads

101

Citations

PlumX Metrics

Main Article Content

Muhammad Aizri Fadillah corresponding author
Department of Science Education, Universitas Negeri Padang, Padang, Indonesia
Usmeldi Usmeldi
Department of Science Education, Universitas Negeri Padang, Padang, Indonesia
Lufri Lufri
Department of Science Education, Universitas Negeri Padang, Padang, Indonesia
Mawardi Mawardi
Department of Science Education, Universitas Negeri Padang, Padang, Indonesia
Festiyed Festiyed
Department of Science Education, Universitas Negeri Padang, Padang, Indonesia

Abstract

Artificial intelligence (AI) in education is increasing, including ChatGPT as a learning tool in physics subjects. This study aims to analyze high school students' perceptions of using ChatGPT in physics learning, focusing on demographic factors such as gender, academic level, and duration of use. Involving 167 students, the study used a survey to evaluate students' views on various aspects of the learning experience with ChatGPT, including effectiveness, clarity, consistency of information, and the tool's ability to enrich understanding of physics concepts. Results showed that students' perceptions were positive overall, with ChatGPT perceived as helping to deepen concept understanding, improving the ability to correct misconceptions, and providing an enjoyable learning experience. Significant differences were found based on gender and academic level, while the duration of ChatGPT use showed no overall significant effect, though longer use enhanced specific benefits. These findings highlight the potential of ChatGPT to support physics education by addressing students' diverse needs and improving learning outcomes, offering insights for educators in integrating AI tools effectively into classrooms.

Keywords
ChatGPT, physics education, student perception, high school students, artificial intelligence

Article Details

How to Cite
Fadillah, M. A., Usmeldi, U., Lufri, L., Mawardi, M., & Festiyed, F. (2024). Exploring user perceptions: The impact of ChatGPT on high school students’ physics understanding and learning. Advances in Mobile Learning Educational Research, 4(2), 1197-1207. https://doi.org/10.25082/AMLER.2024.02.013
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

References

  1. Abubakar, U., Falade, A. A., & Ibrahim, H. A. (2024). Redefining student assessment in Nigerian tertiary institutions: The impact of AI technologies on academic performance and developing countermeasures. Advances in Mobile Learning Educational Research, 4(2), 1149–1159. https://doi.org/10.25082/amler.2024.02.009
  2. Abubakar, U., Onasanya, S. A., & Ibrahim, H. A. (2024). Student perspectives and impact of AI integration in pedagogical practices in Nigerian tertiary institutions. Advances in Mobile Learning Educational Research, 4(2), 1135–1148. https://doi.org/10.25082/amler.2024.02.008
  3. Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), ep429. https://doi.org/10.30935/cedtech/13152
  4. Al-sa’di, A., & Miller, D. (2023). Exploring the Impact of Artificial Intelligence language model ChatGPT on the User Experience. International Journal of Technology, Innovation and Management (IJTIM), 3(1), 1–8. https://doi.org/10.54489/ijtim.v3i1.195
  5. Aravantinos, S., Lavidas, K., Voulgari, I., Papadakis, S., Karalis, T., & Komis, V. (2024). Educational Approaches with AI in Primary School Settings: A Systematic Review of the Literature Available in Scopus. Education Sciences, 14(7), 744. https://doi.org/10.3390/educsci14070744
  6. Baabdullah, A. M. (2024). The precursors of AI adoption in business: Towards an efficient decision-making and functional performance. International Journal of Information Management, 75, 102745. https://doi.org/10.1016/j.ijinfomgt.2023.102745
  7. Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500
  8. Brandhofer, G., & Tengler, K. (2024). Acceptance of artificial intelligence in education: opportunities, concerns and need for action. Advances in Mobile Learning Educational Research, 4(2), 1105–1113. https://doi.org/10.25082/amler.2024.02.005
  9. Byrne, B. M. (2013). Structural Equation Modeling with Mplus. Routledge. https://doi.org/10.4324/9780203807644
  10. Caldarini, G., Jaf, S., & McGarry, K. (2022). A Literature Survey of Recent Advances in Chatbots. Information, 13(1), 41. https://doi.org/10.3390/info13010041
  11. Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00411-8
  12. Chellappa, V., & Luximon, Y. (2024). Understanding the perception of design students towards ChatGPT. Computers and Education: Artificial Intelligence, 7, 100281. https://doi.org/10.1016/j.caeai.2024.100281
  13. Chen, L., Chen, P., & Lin, Z. (2020). Artificial Intelligence in Education: A Review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/access.2020.2988510
  14. Colby. (2023). Generative AI already being used in majority of college classrooms, according to instructors in new wiley survey. Wiley. https://newsroom.wiley.com
  15. Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
  16. Ding, L., Li, T., Jiang, S., & Gapud, A. (2023). Students’ perceptions of using ChatGPT in a physics class as a virtual tutor. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00434-1
  17. Fadillah, M. A., & Sahyar, S. (2023). Development of Higher Order Thinking Skills (HOTS) Test Instruments on Parabolic and Circular Motion Materials in High Schools. Berkala Ilmiah Pendidikan Fisika, 11(3), 329. https://doi.org/10.20527/bipf.v11i3.16697
  18. Festiyed, F., Tanjung, Y. I., & Fadillah, M. A. (2024). ChatGPT in Science Education: A Visualization Analysis of Trends and Future Directions. JOIV: International Journal on Informatics Visualization, 8(3-2), 1614-1624. https://doi.org/10.62527/joiv.8.3-2.2987
  19. Field, A. (2024). Discovering statistics using IBM SPSS statistics. Sage Publications Limited.
  20. Guo, Y., & Lee, D. (2023). Leveraging ChatGPT for Enhancing Critical Thinking Skills. Journal of Chemical Education, 100(12), 4876–4883. https://doi.org/10.1021/acs.jchemed.3c00505
  21. Hair, J. F., Black, B., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: Global edition (7th Editio). Harlow: Pearson Education.
  22. Hakiki, M., Fadli, R., Samala, A. D., Fricticarani, A., Dayurni, P., Rahmadani, K., & Astiti, A. D. (2023). Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment. Advances in Mobile Learning Educational Research, 3(2), 859–872. https://doi.org/10.25082/amler.2023.02.013
  23. Hong, W. C. H., Chi, C., Liu, J., Zhang, Y., Lei, V. N.-L., & Xu, X. (2022). The influence of social education level on cybersecurity awareness and behaviour: a comparative study of university students and working graduates. Education and Information Technologies, 28(1), 439–470. https://doi.org/10.1007/s10639-022-11121-5
  24. Huang, J., Saleh, S., & Liu, Y. (2021). A Review on Artificial Intelligence in Education. Academic Journal of Interdisciplinary Studies, 10(3), 206. https://doi.org/10.36941/ajis-2021-0077
  25. Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115. https://doi.org/10.1016/j.tbench.2023.100115
  26. Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
  27. Kotsis, K. T. (2024). Correcting Students’ Misconceptions in Physics Using Experiments Designed by ChatGPT. European Journal of Contemporary Education and E-Learning, 2(2), 83–100. https://doi.org/10.59324/ejceel.2024.2(2).07
  28. Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kuhn, J., Küchemann, S., & Karolus, J. (2024). Unreflected Acceptance – Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education. HHAI 2024: Hybrid Human AI Systems for the Social Good. https://doi.org/10.3233/faia240195
  29. Lavidas, K., Voulgari, I., Papadakis, S., Athanassopoulos, S., Anastasiou, A., Filippidi, A., Komis, V., & Karacapilidis, N. (2024). Determinants of Humanities and Social Sciences Students’ Intentions to Use Artificial Intelligence Applications for Academic Purposes. Information, 15(6), 314. https://doi.org/10.3390/info15060314
  30. Liang, Y., Zou, D., Xie, H., & Wang, F. L. (2023). Exploring the potential of using ChatGPT in physics education. Smart Learning Environments, 10(1). https://doi.org/10.1186/s40561-023-00273-7
  31. Mai, D. T. T., Da, C. V., & Hanh, N. V. (2024). The use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1328769
  32. Moder, K. (2010). Alternatives to F-test in one-way ANOVA in case of heterogeneity of variances (a simulation study). Psychological Test and Assessment Modeling, 52(4), 343.
  33. Ngo, T. T. A. (2023). The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning (IJET), 18(17), 4–19. https://doi.org/10.3991/ijet.v18i17.39019
  34. Norouzian, R., & Plonsky, L. (2017). Eta- and partial eta-squared in L2 research: A cautionary review and guide to more appropriate usage. Second Language Research, 34(2), 257–271. https://doi.org/10.1177/0267658316684904
  35. Papadakis, S., Kravtsov, H. M., Osadchyi, V. V., Marienko, M. V., Pinchuk, O. P., Shyshkina, M. P., ... & Striuk, A. M. (2023). Revolutionizing education: using computer simulation and cloud-based smart technology to facilitate successful open learning. https://doi.org/10.31812/123456789/7375
  36. Petousi, V., & Sifaki, E. (2020). Contextualising harm in the framework of research misconduct. Findings from discourse analysis of scientific publications. International Journal of Sustainable Development, 23(3/4), 149. https://doi.org/10.1504/ijsd.2020.115206
  37. Sabzalieva, E., & Valentini, A. (2023). ChatGPT and artificial intelligence in higher education: Quick start guide.
  38. Shoufan, A. (2023). Exploring Students’ Perceptions of ChatGPT: Thematic Analysis and Follow-Up Survey. IEEE Access, 11, 38805–38818. https://doi.org/10.1109/access.2023.3268224
  39. Singh, H., Tayarani-Najaran, M.-H., & Yaqoob, M. (2023). Exploring Computer Science Students’ Perception of ChatGPT in Higher Education: A Descriptive and Correlation Study. Education Sciences, 13(9), 924. https://doi.org/10.3390/educsci13090924
  40. Su, Y., Lin, Y., & Lai, C. (2023). Collaborating with ChatGPT in argumentative writing classrooms. Assessing Writing, 57, 100752. https://doi.org/10.1016/j.asw.2023.100752
  41. Susnjak, T., & McIntosh, T. (2024). ChatGPT: The End of Online Exam Integrity? Education Sciences, 14(6), 656. https://doi.org/10.3390/educsci14060656
  42. Taherdoost, H. (2022). What is the best response scale for survey and questionnaire design; Review of different lengths of rating scale/attitude scale/likert scale. International Journal of Academic Research in Management, 8(1), 1–10.
  43. Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
  44. Uğraş, H., Uğraş, M., Papadakis, S., & Kalogiannakis, M. (2024). ChatGPT-Supported Education in Primary Schools: The Potential of ChatGPT for Sustainable Practices. Sustainability, 16(22), 9855. https://doi.org/10.3390/su16229855
  45. Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024). ChatGPT improves creative problem-solving performance in university students: An experimental study. Computers & Education, 215, 105031. https://doi.org/10.1016/j.compedu.2024.105031
  46. Usmeldi, U. (2015). The effectiveness of physics-based research in learning engineering physics. Jurnal Pendidikan IPA Indonesia, 4(1), 79–85. https://doi.org/10.15294/jpii.v4i1.3505
  47. Uygun, D., Aktaş, I., Duygulu, İ., & Köseer, N. (2024). Exploring teachers’ artificial intelligence awareness. Advances in Mobile Learning Educational Research, 4(2), 1093–1104. https://doi.org/10.25082/amler.2024.02.004
  48. Valova, I., Mladenova, T., & Kanev, G. (2024). Students’ Perception of ChatGPT Usage in Education. International Journal of Advanced Computer Science and Applications, 15(1). https://doi.org/10.14569/ijacsa.2024.0150143
  49. Xu, X., Su, Y., Zhang, Y., Wu, Y., & Xu, X. (2024). Understanding learners’ perceptions of ChatGPT: A thematic analysis of peer interviews among undergraduates and postgraduates in China. Heliyon, 10(4), e26239. https://doi.org/10.1016/j.heliyon.2024.e26239