Analysis of Fine Dining Restaurant Reviews for Perception of Customers' Restaurant Service Quality

Authors

  • Semra AKTAŞ POLAT

DOI:

https://doi.org/10.21325/jotags.2022.974

Keywords:

Perceived service, quality, Online reviews, Fine dining restaurants, Aspect-based sentiment analysis, Latent Dirichlet allocation, Machine learning

Abstract

The purpose of this study is to model the perception of customers’ service quality in fine dining restaurants (FDRs) and to determine customer sentiments towards the service quality. I analyzed 22,104 reviews of 25 restaurants on TripAdvisor through Aspect-Based Sentiment Analysis (ABSA). In terms of n-gram language models, the classification performance of sentiment polarity was tested with Support Vector Machine (SVM), Naive Bayes (NB), C4.5, and Gradient Boosted Trees (GBT). I compared the performance of the model with Cohen’s kappa, accuracy, precision, recall, and F-measure results. I found five topic models service, experience, surprise, taste, and food kind by using latent Dirichlet allocation (LDA). In sentiment classification, SVM achieved the best results in bigram with 74.5% average F-measure, 94.4% accuracy, and 49.2% kappa results. This study contributes to the elements related to the perception of service quality in FDRs with psychological quality proposed by the surprise topic. This is one of the few studies conducted with ABSA on the perception of service quality in FDRs, and it is the first study examining the issue in terms of n-gram language models.

References

Akhtar, M. S., Gupta, D., Ekbal, A., & Bhattacharyya, P. (2017). Feature selection and ensemble construction: A two-step method for aspect based sentiment analysis. Knowledge-Based Systems, 125, 116–135. https://doi.org/10.1016/j.knosys.2017.03.020

Aktas-Polat, S., & Polat, S. (2022). Discovery of factors affecting tourists' fine dining experiences at five-star hotel restaurants in Istanbul. British Food Journal, 124(1), 221-238. https://doi.org/10.1108/BFJ-02-2021-0138

Aktas-Polat, S., & Polat, S. (2020). A theoretical analysis of food meaning in anthropology and sociology. Tourism: An International Interdisciplinary Journal, 68(3), 278–293. https://doi.org/10.37741/t.68.3.3

Alaei, A. R., Becken, S., & Stantic B. (2019). Sentiment analysis in tourism: Capitalizing on big data. Journal of Travel Research, 58(2), 175–191. https://doi.org/10.1177/0047287517747753

Antun, J. M., Frash, R. E., Costen, W., & Runyan, R. C. (2010). Accurately assessing expectations most important to restaurant patrons: The creation of the DinEX Scale. Journal of Foodservice Business Research, 13(4), 360–379. https://doi.org/10.1080/15378020.2010.524539

Bagheri, A., Saraee, M., & De Jong, F. (2014). ADM-LDA: An aspect detection model based on topic modelling using the structure of review sentences. Journal of Information Science, 40(5), 621–636.

Bengio, Y., & Grandvalet, Y. (2004). No unbiased estimator of the variance of k-fold cross-validation. Journal of Machine Learning Research, 5, 1089–1105.

Bermingham, L., & Lee, I. (2014). Spatio-temporal sequential pattern mining for tourism sciences. Procedia Computer Science, 29, 379–389.

Berry, L. L., Parasuraman, A., & Zeithaml, V. A. (1988). The service-quality puzzle. Business Horizons, 31(5), 35–43.

Bhuyan, M. P., & Sarma, S. K. (2019). An n-gram based model for predicting of word-formation in Assamese language. Journal of Information and Optimization Sciences, 40(2), 427–440, https://doi.org/10.1080/02522667.2019.1580883

Bitner, M. J. (1992). Servicescapes: The impact of physical surroundings on customers and employees. Journal of Marketing, 56(2), 57–71. https://doi.org/10.2307/1252042

Bojanic, D. C., & Rosen, L. D. (1994). Measuring service quality in restaurants: An application of the SERVQUAL instrument. Journal of Hospitality & Tourism Research, 18(1), 3–14. https://doi.org/10.1177/109634809401800102

Chase R. B., & Apte U. M. (2007). A history of research in service operations: What’s the big idea? Journal of Operations Management, 25(2), 375–386.

Cheng, C. C., Chen, C. T., Hsu, F. S., & Hu, H. Y. (2012). Enhancing service quality improvement strategies of fine-dining restaurants: New insights from integrating a two-phase decision-making model of IPGA and DEMATEL analysis. International Journal of Hospitality Management, 31(4), 1155–1166.

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.

Cronin, J. J., & Taylor, S. A. (1992). Measuring service quality: A reexamination and extension. Journal of Marketing, 56(3), 55–68.

Dey, A., Jenamani, M., & Thakkar, J. J. (2018). Senti-n-gram : An n-gram lexicon for sentiment analysis. Expert Systems with Applications, 103, 92–105. https://doi.org/ 10.1016/j.eswa.2018.03.004

Duan, W., Yu, Y., Cao, Q., & Levy, S. (2016). Exploring the impact of social media on hotel service performance. Cornell Hospitality Quarterly, 57(3), 282–296. https://doi.org/10.1177/1938965515620483

Feldman, R. (2013). Techniques and applications for sentiment analysis. Communications of the ACM, 56(4), 82–89. https://doi.org/10.1145/2436256.2436274

Fu, Y., Hao, J. X., Li, X., & Hsu. C. H. (2019). Predictive accuracy of sentiment analytics for tourism: A meta learning perspective on Chinese travel news. Journal of Travel Research, 58(4), 666–679. https://doi.org/10.1177/0047287518772361

Gagić, S., Tešanović, D., & Jovičić, A. (2013). The vital components of restaurant quality that affect guest satisfaction. Turizam, 17(4), 166–176.

García-Pablos, A., Cuadros, M., & Rigau, G. (2018). W2VLDA: Almost unsupervised system for aspect based sentiment analysis. Expert Systems with Applications, 91, 127–137. https://doi.org/10.1016/j.eswa.2017.08.049

Geler, Z., Savić, M., Bratić, B., Kurbalija, V., Ivanović, M., & Dai, W. (2021). Sentiment prediction based on analysis of customers assessments in food serving businesses. Connection Science, 33(3), 674–692. https://doi.org/10.1080/09540091.2020.1870436

Grönroos, C. (1984). A service quality model and its market implications. European Journal of Marketing, 18(4), 36–44.

Guo, Y., Barnes, S. J., & Jia, Q. (2017). Mining meaning from online ratings and reviews: Tourist satisfaction analysis using latent Dirichlet allocation. Tourism Management, 59, 467–483. http://dx.doi.org/10.1016/j.tourman.2016.09.009

Hansen, K. V. (2014). Development of SERVQUAL and DINESERV for measuring meal experiences in eating establishments. Scandinavian Journal of Hospitality and Tourism, 14(2), 116–134. https://doi.org/10.1080/15022250.2014.886094

Hearst, M. (2003). What is text mining. SIMS, UC Berkeley.

Hu, M., & Liu, B. (2004). Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. Association for Computing Machinery, pp. 168–177.

Huang, C. H. (2003). A comparison of the service quality perspectives between restaurant customers and restaurateurs in Taiwan. Journal of Foodservice Business Research, 6(2), 87–104. https://doi.org/10.1300/J369v06n02_07

Hwang, J., & Ok, C. (2013). The antecedents and consequence of consumer attitudes toward restaurant brands: A comparative study between casual and fine dining restaurants. International Journal of Hospitality Management, 32, 121–131. https://doi.org/10.1016/j.ijhm.2012.05.002

James, T. L., Calderon, E. D. V., & Cook, D. F. (2017). Exploring patient perceptions of healthcare service quality through analysis of unstructured feedback. Expert Systems with Applications, 71, 479–492. https://doi.org/10.1016/j.eswa.2016.11.004

Jin, N. P., Line, N. D., & Goh, B. (2013). Experiential value, relationship quality, and customer loyalty in full-service restaurants: The moderating role of gender. Journal of Hospitality Marketing & Management, 22(7), 679–700. http://dx.doi.org/10.1080/19368623.2013.723799

Johns, N., & Tyas, P. (1996). Use of service-quality gap theory to differentiate between foodservice outlets. The Service Industries Journal, 16(3), 321–346.

Johns, N., & Howard, A. (1998). Customer expectations versus perceptions of service performance in the foodservice industry. International Journal of Service Industry Management, 9(3), 248–265. https://doi.org/10.1108/09564239810223556

Kala, D. (2020). Examining the impact of food attributes and restaurant services on tourist satisfaction: Evidence from mountainous state of India. Journal of Quality Assurance in Hospitality & Tourism, 21(4), 430–453. https://doi.org/10.1080/1528008X.2019.1672235

Kang, H., Yoo, S. J., & Han, D. (2012). Senti-lexicon and improved Naïve Bayes algorithms for sentiment analysis of restaurant reviews. Expert Systems with Applications, 39(5), 6000–6010. https://doi.org/10.1016/j.eswa.2011.11.107

Keith, N. K., & Simmers, C. S. (2011). Measuring service quality perceptions of restaurant experiences: The disparity between comment cards and DINESERV. Journal of Foodservice Business Research, 14(1), 20–32. https://doi.org/10.1080/15378020.2011.548209

Kim, H. J., McCahon, C., & Miller, J. (2003). Assessing service quality in Korean casual-dining restaurants using DINESERV. Journal of Foodservice Business Research, 6(1), 67–86. https://doi.org/10.1300/j369v06n01_05

Kim, K., Park, O. J., Yun, S., & Yun, H. (2017). What makes tourists feel negatively about tourism destinations? Application of hybrid text mining methodology to smart destination management. Technological Forecasting and Social Change, 123, 362–369. https://doi.org/10.1016/j.techfore.2017.01.001

Kirilenko, A. P., Stepchenkova, S. O., Kim, H., & Li, X. (2018). Automated sentiment analysis in tourism: Comparison of approaches. Journal of Travel Research, 57(8), 1012–1025. https://doi.org/10.1177/2F0047287517729757

Knutson, B. J., Stevens, P., & Patton, M. (1996). DINESERV: Measuring service quality in quick service, casual/theme, and fine dining restaurants. Journal of Hospitality & Leisure Marketing, 3(2), 35–44. https://doi.org/10.1300/J150v03n02_04

Korfiatis, N., Stamolampros, P., Kourouthanassis, P., & Sagiadinos, V. (2018). Measuring service quality from unstructured data: A topic modeling application on airline passengers’ online reviews. Expert Systems with Applications, 116, 472–486. https://doi.org/10.1016/j.eswa.2018.09.037

Kwon, W., Lee, M., & Back, K. J. (2020). Exploring the underlying factors of customer value in restaurants: A machine learning approach. International Journal of Hospitality Management, 91, 102643. https://doi.org/10.1016/j.ijhm.2020.102643

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.

Lee, L., Lee, M. J., & Dewald, B. (2016). Measuring the customers’ perception of tangible service quality in the restaurant industry: An emphasis on the upscale dining segment. Journal of Foodservice Business Research, 19(1), 21–38. http://dx.doi.org/10.1080/15378020.2016.1129216

Li, H., Liu, H., & Zhang, Z. (2020). Online persuasion of review emotional intensity: A text mining analysis of restaurant reviews. International Journal of Hospitality Management, 89, 102558. https://doi.org/10.1016/j.ijhm.2020.102558

Lim, J., & Lee, H. C. (2020). Comparisons of service quality perceptions between full service carriers and low cost carriers in airline travel. Current Issues in Tourism, 23(10), 1261–1276. https://doi.org/10.1080/13683500.2019.1604638

Lisnawati, L., & Astawa, I. P. (2020). Service quality analisys of ‘Table8’ Chinese restaurant at the Mulia, Mulia resort and Mulia villas. Journal of Applied Sciences in Travel and Hospitality, 3(1), 22–29.

Luo, Y., He, J., Mou, Y., Wang, J., & Liu, T. (2021). Exploring China's 5A global geoparks through online tourism reviews: A mining model based on machine learning approach. Tourism Management Perspectives, 37, 100769. https://doi.org/10.1016/j.tmp.2020.100769

Luo, Y., & Xu, X. (2019). Predicting the helpfulness of online restaurant reviews using different machine learning algorithms: A case study of Yelp. Sustainability, 11(19), 5254. http://dx.doi.org/10.3390/su11195254

MacLaurin, D. J., & MacLaurin, T. L. (2000). Customer perceptions of Singapore’s theme restaurants. Cornell Hotel and Restaurant Administration Quarterly, 41(3), 75–85. https://doi.org/10.1177/001088040004100319

Madanoglu, M. (2006). Validating restaurant service quality dimensions. Journal of Foodservice Business Research, 7(4), 127–147. https://doi.org/10.1300/J369v07n04_07

Marković, S., Raspor, S., & Šegarić, K. (2010). Does restaurant performance meet customers’ ecpectations? An assessment of restaurant service quality using a modified dineserv approach. Tourism and Hospitality Management, 16(2), 181–195.

McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282.

Mejia, J., Mankad, S., & Gopal, A. (2020). Service quality using text mining: Measurement and consequences. Manufacturing & Service Operations Management, 23(6), 1354–1372 https://doi.org/10.1287/msom.2020.0883

Moro, S., Lopes, R. J., Esmerado, J., & Botelho, M. (2020). Service quality in airport hotel chains through the lens of online reviewers. Journal of Retailing and Consumer Services, 56, 102193. https://doi.org/10.1016/j.jretconser.2020.102193

Palese, B., & Piccoli, G. (2016). Online reviews as a measure of service quality. In 2016 Pre-ICIS SIGDSA/IFIP WG8. 3 Symposium, Dublin 2016.

Palese, B., & Usai, A. (2018). The relative importance of service quality dimensions in e-commerce experiences. International Journal of Information Management, 40, 132–140. https://doi.org/10.1016/j.ijinfomgt.2018.02.001

Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the ACL-02 conference on empirical methods in natural language processing-Volume 10. Association for Computational Linguistics, pp. 79–86.

Pang, B., & Lee, L. (2004). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the 42nd annual meeting on Association for Computational Linguistics. Association for Computational Linguistics.

Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis, Foundations and Trends® in Information Retrieval, 2(1–2), 1–135. https://doi.org/10.1561/1500000001s

Pantelidis, I. S. (2010). Electronic meal experience: A content analysis of online restaurant comments. Cornell Hospitality Quarterly, 51(4), 483–491. https://doi.org/10.1177/1938965510378574

Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1985). A conceptual model of service quality and its ımplications for future research. The Journal of Marketing, 49(4), 41–50.

Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1988). Servqual: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(1), 12–40.

Philander, K., & Zhong, Y. Y. (2016). Twitter sentiment analysis: Capturing sentiment from integrated resort tweets. International Journal of Hospitality Management, 55, 16–24. http://dx.doi.org/10.1016/j.ijhm.2016.02.001

Quinlan, J. R. (1993). C4.5: Programs for machine learning. Morgan Kaufmann Publishers.

Raajpoot, N. A. (2002). TANGSERV: A multi-item scale for measuring customer tangible quality in foodservice industry. Journal of Foodservice Business Research, 5(2), 109–127. https://doi.org/10.1300/J369v05n02_08

Rust, R. T., & Oliver, R. L. (1994). Service quality: Insights and managerial implications from the frontier. R. T. Rust, & R. L. Oliver (Ed.s.), Service quality: New directions in theory and practice. Sage Publications.

Ryu, K., & Jang, S. S. (2008). DINESCAPE: A scale for customers’ perception of dining environments. Journal of Foodservice Business Research, 11(1), 2–22. https://doi.org/10.1080/15378020801926551

Schuckert, M., Liu, X., & Law, R. (2015). Hospitality and tourism online reviews: Recent trends and future directions. Journal of Travel & Tourism Marketing, 32(5), 608–621. https://doi.org/10.1080/10548408.2014.933154

Stevens, P., Knutson, B., & Patton, M. (1995). DINESERV: A tool for measuring service quality in restaurants. The Cornell Hotel and Restaurant Administration Quarterly, 36(2), 5–60. https://doi.org/10.1016/0010-8804(95)93844-K

Sutherland, I., Sim, Y., Lee, S. K., Byun, J., & Kiatkawsin, K. (2020). Topic modeling of online accommodation reviews via latent Dirichlet allocation. Sustainability, 12, 1821. https://doi.org/10.3390/su12051821

Taecharungroj, V., & Mathayomchan, B. (2019). Analysing TripAdvisor reviews of tourist attractions in Phuket, Thailand. Tourism Management, 75, 550–568. https://doi.org/10.1016/j.tourman.2019.06.020

Taecharungroj, V., Warnaby, G., & Parker, C. (2021). Responding to the voice of the markets: an analysis of Tripadvisor reviews of UK retail markets. Journal of Place Management and Development, 14(2), 180-200, https://doi.org/10.1108/JPMD-02-2020-0016.

Tan, P. N., Steinbach, M., & Kumar, V. (2014). Introduction to data mining. Pearson Education Limited.

Tao, D., Yang, P., & Feng, H. (2020). Utilization of text mining as a big data analysis tool for food science and nutrition. Comprehensive Reviews in Food Science and Food Safety, 19(2), 875–894. https://doi.org/10.1111/1541-4337.12540

Tian, G., Lu, L., & McIntosh, C. (2021). What factors affect consumers’ dining sentiments and their ratings: Evidence from restaurant online review data. Food Quality and Preference, 88, 104060. https://doi.org/10.1016/j.foodqual.2020.104060

TripAdvisor (2021). Travelers’ choice best of the best. https://www.tripadvisor.com/TravelersChoice.

Wall, E. A., & Berry, L. L. (2007). The combined effects of the physical environment and employee behavior on customer perception of restaurant service quality. Cornell Hotel and Restaurant Administration Quarterly, 48(1), 59–69. https://doi.org/10.1177/0010880406297246

Yan, X., Wang, J., & Chau, M. (2015). Customer revisit intention to restaurants: Evidence from online reviews. Information Systems Frontiers, 17(3), 645–657. https://doi.org/10.1007/s10796-013-9446-5

Yousefpour, A., Ibrahim, R., Hamed, H. N. A., & Hajmohammadi, M. S. (2014). A comparative study in sentiment analysis. Advances in Environmental Biology, 8(13), 53–68.

Zeithaml, V. (1987). Defining and relating price, perceived quality, and perceived value. (Report No. 87–101). Marketing Science Institute.

Zhang, L., & Liu, B. (2014). Aspect and entity extraction for opinion mining. W. W. Chu (Ed.), Data mining and knowledge discovery for big data. Studies in big data, 1, 1–40. Springer. 10.1007/978-3-642-40837-3_1

Zhang, W., Xu, H., & Wan, W. (2012). Weakness finder: Find product weakness from Chinese reviews by using aspects based sentiment analysis. Expert Systems with Applications, 39(11), 10283–10291. https://doi.org/10.1016/j.eswa.2012.02.166

Zhao, G., Qian, X., Lei, X., & Mei, T. (2016). Service quality evaluation by exploring social users’ contextual information. IEEE Transactions on Knowledge and Data Engineering, 28(12), 3382–3394. https://doi.org/10.1109/TKDE.2016.2607172

Published

03/03/2023

How to Cite

AKTAŞ POLAT, S. (2023). Analysis of Fine Dining Restaurant Reviews for Perception of Customers’ Restaurant Service Quality. Journal of Tourism & Gastronomy Studies, 10(1), 11–28. https://doi.org/10.21325/jotags.2022.974