ChatGPT Uzaktan Eğitim Sınavlarında Başarılı Olabilir Mi? Turizm Alanında Doğruluk ve Doğrulama Üzerine Bir Araştırma (Can ChatGPT Succeed
DOI:
https://doi.org/10.21325/jotags.2023.1224Keywords:
Tourism, ChatGPT, Exam, Distance educationAbstract
The biggest concern about online assignments and exams in distance education is that students cannot be supervised sufficiently. Artificial intelligence applications based on language modeling techniques, such as ChatGPT, are also important factors that may increase this concern. Accordingly, this study aims to show how ChatGPT performs in the accuracy and validation stages of homework and multiple-choice exams in tourism. When the result of the study is examined, it has been determined that the emergence of technologies such as ChatGPT poses a significant threat to the integrity of online exams. The fact that ChatGPT gave incorrect answers to homework questions and that the sources specified did not exist showed that ChatGPT did not achieve success in the accuracy and verification of such questions. However, it was observed that it was pretty successful against multiple-choice questions. Out of 20 multiple-choice questions, it answered 16 of them correctly and 4 of them incorrectly. This situation revealed that ChatGPT performed at the level expected from a good tourism student in measuring multiple-choice tourism knowledge.
References
Ali, F., & OpenAI, Inc, C. (2023). Let the devil speak for itself: Should ChatGPT be allowed or banned in hospitality and tourism schools? Journal of Global Hospitality and Tourism, 2(1), 1-6. https://www.doi.org/10.5038/2771- 5957.2.1.1016
Andrade, I. M. D., & Tumelero, C. (2022). Increasing customer service efficiency through artificial intelligence chatbot. Revista de Gestão, 29(3), 238-251. https://doi.org/10.1108/REGE-07-2021-0120
Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023). Evaluating the performance of chatgpt in ophthalmology: An analysis of its successes and shortcomings. medRxiv, 2023-01. https://doi.org/10.1101/2023.01.22.23284882
Bahar, O., & Kozak, M. (2015). Turizm Ekonomisi, (7. Baskı). Ankara: Detay Yayıncılık.
Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Available at SSRN 4337484. http://dx.doi.org/10.2139/ssrn.4337484
Bordt, S., & Luxburg, V. U. (2023). ChatGPT participates in a computer science exam. arXiv preprint arXiv:2303.09461. https://doi.org/10.48550/arXiv.2303.09461
Carvalho, I., & Ivanov, S. (2023). ChatGPT for tourism: applications, benefits and risks. Tourism Review. https://doi.org/10.1108/TR-02-2023-0088
Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. (2023). ChatGPT goes to law school. Minnesota Legal Studies Research Paper No. 23-03, http://dx.doi.org/10.2139/ssrn.4335905
Creswell, J. W. (2007). Qualitative inquiry and research method: Choosing among five approaches. Academic Press. Sage.
Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating academic answers generated using ChatGPT. Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.3c00087
Fijačko, N., Gosak, L., Štiglic, G., Picard, C. T., & Douma, M. J. (2023). Can ChatGPT pass the life support exams without entering the American heart association course? Resuscitation, 185. https://doi.org/10.1016/j.resuscitation.2023.109732
Geerling, W., Mateer, G. D., Wooten, J., & Damodaran, N. (2023). ChatGPT has aced the test of understanding in college economics: Now what?. The American Economist, https://doi.org/10.1177/05694345231169654
Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2022). How well does ChatGPT do when taking the medical licensing exams? The ımplications of large language models for medical education and knowledge assessment. medRxiv, 2022-12. https://doi.org/10.1101/2022.12.23.22283901
Goeldner, C. R. & Ritchie, J. B. (2007). Tourism principles, practices, philosophies. John Wiley & Sons.
Göktaş, L.S. (2020). Turist vergisi ödeme istekliliğini etkileyen faktörler, İstanbul Üniversitesi Sosyal Bilimler Enstitüsü Turizm İşletmeciliği Anabilim Dalı Doktora Tezi. İstanbul.
Haleem, A., Javaid, M., & Singh, R. P. (2023). An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. Benchcouncil Transactions On Benchmarks, Standards And Evaluations, https://doi.org/10.1016/j.tbench.2023.100089.
Ivanov, S., & Soliman, M. (2023). Game of algorithms: ChatGPT implications for the future of tourism education and research. Journal of Tourism Futures. https://doi.org/10.1108/JTF-02-2023-0038
İslamoğlu, A. H., & Alnıaçık, Ü. (2016). Sosyal bilimlerde araştırma yöntemleri. 5. Baskı İstanbul: Beta Yayınevi.
Jalil, S., Rafi, S., LaToza, T. D., Moran, K., & Lam, W. (2023). Chatgpt and software testing education: Promises & perils. arXiv preprint arXiv:2302.03287.
Kirmani, A.R. (2022). Artificial intelligence-enabled science poetry, ACS Energy Letters, Vol. 8, pp. 574-576. https://doi.org/10.1021/acsenergylett.2c02758
Kurian, N., Cherian, J. M., Sudharson, N. A., Varghese, K. G., & Wadhwa, S. (2023). AI is now everywhere. British Dental Journal, 234(2),72-72. https://doi.org/10.1038/s41415-023-5461-1
Lecler, A., Duron, L., & Soyer, P. (2023). Revolutionizing radiology with GPT-based models: Current applications, future possibilities and limitations of ChatGPT. Diagnostic and Interventional Imaging. https://doi.org/10.1016/j.diii.2023.02.003
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021). GPT understands, too. arXiv preprint arXiv:2103.10385.
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi:10.3390/educsci13040410
Mogali, S. R. (2023). Initial impressions of ChatGPT for anatomy education. Anatomical Sciences Education. https://doi.org/10.1002/ase.2261
Nithuna, S. & Laseena, C. (2020). Review on implementation techniques of chatbot. In Proceedings of the 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 28–30 July 2020; pp. 157–161.
O'Connor, S. & ChatGPT (2022). Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse? Nurse Education in Practice, 66, 103537-103537. https://doi.org/10.1016/j.nepr.2022.103537
OpenAI. (2015). OpenAI. https://openai.com/about/ (Erişim Tarihi: 07.04.2023).
Pursnani, V., Sermet, Y., & Demir, I. (2023). Performance of ChatGPT on the US fundamentals of engineering exam: comprehensive assessment of proficiency and potential ımplications for professional environmental engineering practice. arXiv preprint arXiv:2304.12198.
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9
Ryznar, M. (2023). Exams in the time of ChatGPT. Washington and Lee Law Review Online, 80(5), 305.
Skavronskaya, L., Hadinejad, A., & Cotterell, D. (2023). Reversing the threat of artificial intelligence to opportunity: a discussion of ChatGPT in tourism education. Journal of Teaching in Travel & Tourism, 1-6. https://doi.org/10.1080/15313220.2023.2196658
Stokel-Walker, C, (2023) ChatGPT listed as author on research papers: many scientists disapprove. Nature. https://doi.org/10.1038/d41586-023-00107-z
Susnjak, T. (2022). ChatGPT: The end of online exam integrity? Preprint. ArXiv:2212.09292v1. https://doi.org/10.48550/arXiv.2212.09292
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3, 1– 10. https://doi.org/10.1016/j.caeai.2022.100075
Szabo, A. (2023). ChatGPT a breakthrough in science and education: Can it fail a test? OSF Prepr.
Taecharungroj, V. (2023). What can ChatGPT do? Analyzing early reactions to the ınnovative AI chatbot on Twitter.
Big Data and Cognitive Computing, 7(1), 35. https://doi.org/10.3390/bdcc7010035
Terwiesch, C. (2023). Would chat GPT3 get a Wharton MBA? A prediction based on its performance in the operations management course. Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania.
Thorat, S.A. & Jadhav, V. (2020). A review on implementation issues of rule-based chatbot systems. In Proceedings of the International Conference on Innovative Computing & Communications (ICICC); SSRN: Rochester, NY, USA, 2020. http://dx.doi.org/10.2139/ssrn.3567047
Wang, X., Gong, Z., Wang, G., Jia, J., Xu, Y., Zhao, J., Fan, Q., Wu, S., Hu, W. & Li, X. (2023). ChatGPT performs on the Chinese national medical licensing examination. https://doi.org/10.21203/rs.3.rs-2584079/v1
Yıldırım, S. (2020). Turizm Talebi. İçinde (edt. Esen, E. & Çakır, P.G.) Turizm Ekonomisi. Anadolu Üniversitesi Yayını No: 3963. Eskişehir.
Zhu, J. J., Jiang, J., Yang, M., & Ren, Z. J. (2023). ChatGPT and environmental research. Environmental Science & Technology. https://doi.org/10.1021/acs.est.3c01818
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Journal of Tourism & Gastronomy Studies
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
