ChatGPT Uzaktan Eğitim Sınavlarında Başarılı Olabilir Mi? Turizm Alanında Doğruluk ve Doğrulama Üzerine Bir Araştırma (Can ChatGPT Succeed

Yazarlar

  • Levent Selman GÖKTAŞ

DOI:

https://doi.org/10.21325/jotags.2023.1224

Anahtar Kelimeler:

Turizm- ChatGPT- Sınav- Uzaktan eğitim

Öz

Uzaktan eğitim sürecinde gerçekleştirilen online ödev ve sınavlarda en çok endişe duyulan durum öğrencilerin yeterince denetlenemiyor olmasıdır. ChatGPT gibi dil modeli teknolojisine dayalı yapay zekâ uygulamaları da bu endişeyi arttırabilecek önemli unsurlardır. Bu doğrultuda çalışma, ChatGPT’nin turizm alanında gerçekleştirilecek ödev ve çoktan seçmeli sınavlarda, doğruluk ve doğrulama aşamalarında nasıl bir başarı ortaya koyduğunu göstermeyi amaçlamaktadır. Çalışma sonucu incelendiği zaman, ChatGPT gibi teknolojilerin ortaya çıkmasının çevrimiçi sınavların bütünlüğüne yönelik önemli bir tehdit oluşturduğu belirlenmiştir. Ödev sorularında hatalı yanıtlar vermesi ve belirtmiş olduğu kaynakların gerçekte var olmaması ChatGPT’nin bu tarz sorularda hem doğruluk hem de doğrulama aşamalarında yeterli başarıya ulaşamadığını göstermiştir. Fakat çoktan seçmeli sorular karşısında oldukça başarılı olduğu görülmüştür. 20 adet çoktan seçmeli sorunun 16 adedine doğru 4 adedine ise yanlış cevap vermiştir. Bu durum ChatGPT’nin çoktan seçmeli turizm bilgisinin ölçülmesinde iyi bir turizm öğrencisinden beklenen düzeyde performans gösterdiğini ortaya koymuştur.

Referanslar

Ali, F., & OpenAI, Inc, C. (2023). Let the devil speak for itself: Should ChatGPT be allowed or banned in hospitality and tourism schools? Journal of Global Hospitality and Tourism, 2(1), 1-6. https://www.doi.org/10.5038/2771- 5957.2.1.1016

Andrade, I. M. D., & Tumelero, C. (2022). Increasing customer service efficiency through artificial intelligence chatbot. Revista de Gestão, 29(3), 238-251. https://doi.org/10.1108/REGE-07-2021-0120

Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023). Evaluating the performance of chatgpt in ophthalmology: An analysis of its successes and shortcomings. medRxiv, 2023-01. https://doi.org/10.1101/2023.01.22.23284882

Bahar, O., & Kozak, M. (2015). Turizm Ekonomisi, (7. Baskı). Ankara: Detay Yayıncılık.

Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Available at SSRN 4337484. http://dx.doi.org/10.2139/ssrn.4337484

Bordt, S., & Luxburg, V. U. (2023). ChatGPT participates in a computer science exam. arXiv preprint arXiv:2303.09461. https://doi.org/10.48550/arXiv.2303.09461

Carvalho, I., & Ivanov, S. (2023). ChatGPT for tourism: applications, benefits and risks. Tourism Review. https://doi.org/10.1108/TR-02-2023-0088

Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. (2023). ChatGPT goes to law school. Minnesota Legal Studies Research Paper No. 23-03, http://dx.doi.org/10.2139/ssrn.4335905

Creswell, J. W. (2007). Qualitative inquiry and research method: Choosing among five approaches. Academic Press. Sage.

Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating academic answers generated using ChatGPT. Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.3c00087

Fijačko, N., Gosak, L., Štiglic, G., Picard, C. T., & Douma, M. J. (2023). Can ChatGPT pass the life support exams without entering the American heart association course? Resuscitation, 185. https://doi.org/10.1016/j.resuscitation.2023.109732

Geerling, W., Mateer, G. D., Wooten, J., & Damodaran, N. (2023). ChatGPT has aced the test of understanding in college economics: Now what?. The American Economist, https://doi.org/10.1177/05694345231169654

Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2022). How well does ChatGPT do when taking the medical licensing exams? The ımplications of large language models for medical education and knowledge assessment. medRxiv, 2022-12. https://doi.org/10.1101/2022.12.23.22283901

Goeldner, C. R. & Ritchie, J. B. (2007). Tourism principles, practices, philosophies. John Wiley & Sons.

Göktaş, L.S. (2020). Turist vergisi ödeme istekliliğini etkileyen faktörler, İstanbul Üniversitesi Sosyal Bilimler Enstitüsü Turizm İşletmeciliği Anabilim Dalı Doktora Tezi. İstanbul.

Haleem, A., Javaid, M., & Singh, R. P. (2023). An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. Benchcouncil Transactions On Benchmarks, Standards And Evaluations, https://doi.org/10.1016/j.tbench.2023.100089.

Ivanov, S., & Soliman, M. (2023). Game of algorithms: ChatGPT implications for the future of tourism education and research. Journal of Tourism Futures. https://doi.org/10.1108/JTF-02-2023-0038

İslamoğlu, A. H., & Alnıaçık, Ü. (2016). Sosyal bilimlerde araştırma yöntemleri. 5. Baskı İstanbul: Beta Yayınevi.

Jalil, S., Rafi, S., LaToza, T. D., Moran, K., & Lam, W. (2023). Chatgpt and software testing education: Promises & perils. arXiv preprint arXiv:2302.03287.

Kirmani, A.R. (2022). Artificial intelligence-enabled science poetry, ACS Energy Letters, Vol. 8, pp. 574-576. https://doi.org/10.1021/acsenergylett.2c02758

Kurian, N., Cherian, J. M., Sudharson, N. A., Varghese, K. G., & Wadhwa, S. (2023). AI is now everywhere. British Dental Journal, 234(2),72-72. https://doi.org/10.1038/s41415-023-5461-1

Lecler, A., Duron, L., & Soyer, P. (2023). Revolutionizing radiology with GPT-based models: Current applications, future possibilities and limitations of ChatGPT. Diagnostic and Interventional Imaging. https://doi.org/10.1016/j.diii.2023.02.003

Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021). GPT understands, too. arXiv preprint arXiv:2103.10385.

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi:10.3390/educsci13040410

Mogali, S. R. (2023). Initial impressions of ChatGPT for anatomy education. Anatomical Sciences Education. https://doi.org/10.1002/ase.2261

Nithuna, S. & Laseena, C. (2020). Review on implementation techniques of chatbot. In Proceedings of the 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 28–30 July 2020; pp. 157–161.

O'Connor, S. & ChatGPT (2022). Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse? Nurse Education in Practice, 66, 103537-103537. https://doi.org/10.1016/j.nepr.2022.103537

OpenAI. (2015). OpenAI. https://openai.com/about/ (Erişim Tarihi: 07.04.2023).

Pursnani, V., Sermet, Y., & Demir, I. (2023). Performance of ChatGPT on the US fundamentals of engineering exam: comprehensive assessment of proficiency and potential ımplications for professional environmental engineering practice. arXiv preprint arXiv:2304.12198.

Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9

Ryznar, M. (2023). Exams in the time of ChatGPT. Washington and Lee Law Review Online, 80(5), 305.

Skavronskaya, L., Hadinejad, A., & Cotterell, D. (2023). Reversing the threat of artificial intelligence to opportunity: a discussion of ChatGPT in tourism education. Journal of Teaching in Travel & Tourism, 1-6. https://doi.org/10.1080/15313220.2023.2196658

Stokel-Walker, C, (2023) ChatGPT listed as author on research papers: many scientists disapprove. Nature. https://doi.org/10.1038/d41586-023-00107-z

Susnjak, T. (2022). ChatGPT: The end of online exam integrity? Preprint. ArXiv:2212.09292v1. https://doi.org/10.48550/arXiv.2212.09292

Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3, 1– 10. https://doi.org/10.1016/j.caeai.2022.100075

Szabo, A. (2023). ChatGPT a breakthrough in science and education: Can it fail a test? OSF Prepr.

Taecharungroj, V. (2023). What can ChatGPT do? Analyzing early reactions to the ınnovative AI chatbot on Twitter.

Big Data and Cognitive Computing, 7(1), 35. https://doi.org/10.3390/bdcc7010035

Terwiesch, C. (2023). Would chat GPT3 get a Wharton MBA? A prediction based on its performance in the operations management course. Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania.

Thorat, S.A. & Jadhav, V. (2020). A review on implementation issues of rule-based chatbot systems. In Proceedings of the International Conference on Innovative Computing & Communications (ICICC); SSRN: Rochester, NY, USA, 2020. http://dx.doi.org/10.2139/ssrn.3567047

Wang, X., Gong, Z., Wang, G., Jia, J., Xu, Y., Zhao, J., Fan, Q., Wu, S., Hu, W. & Li, X. (2023). ChatGPT performs on the Chinese national medical licensing examination. https://doi.org/10.21203/rs.3.rs-2584079/v1

Yıldırım, S. (2020). Turizm Talebi. İçinde (edt. Esen, E. & Çakır, P.G.) Turizm Ekonomisi. Anadolu Üniversitesi Yayını No: 3963. Eskişehir.

Zhu, J. J., Jiang, J., Yang, M., & Ren, Z. J. (2023). ChatGPT and environmental research. Environmental Science & Technology. https://doi.org/10.1021/acs.est.3c01818

Yayınlanmış

01-07-2023

Nasıl Atıf Yapılır

ChatGPT Uzaktan Eğitim Sınavlarında Başarılı Olabilir Mi? Turizm Alanında Doğruluk ve Doğrulama Üzerine Bir Araştırma (Can ChatGPT Succeed . (2023). Turizm & Gastronomi Çalışmaları Dergisi, 11(2), 892-905. https://doi.org/10.21325/jotags.2023.1224