TY - GEN
T1 - Sentiment Analysis and Topic Modeling of E-Grocery Application Reviews Using Naive Bayes and Support Vector Machine
T2 - 3rd International Conference on Electronic and Electrical Engineering and Intelligent System, ICE3IS 2023
AU - Dhammananda, Jefka
AU - Budi, Indra
AU - Santoso, Aris Budi
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Segari is a customer-centric company with a core value of being obsessed with its customers. The lack of human resources and the abundance of customer reviews that need to be analyzed hinder the process of extracting information from these reviews. Therefore, a machine learning model is needed to automatically perform sentiment analysis and topic modeling. The information extracted from sentiment analysis can be used as a reference to maintain service quality based on positive sentiments, while the results of negative sentiments can be used for evaluation to improve Segari's services and application. The data used on this research were customer reviews from the Google Play Store. The model development process includes data collection, data labeling, data preprocessing, feature extraction, sentiment classification model, model evaluation, and topic modeling. The researcher utilized two classification algorithms, NB and SVM, on a total of 10,507 reviews. The data shows that 74.37% express positive sentiments, while 25.63% express negative sentiments. The results of the study indicate that SVM with oversampling achieved the best model performance, with a recall of 89.98%. Additionally, the researcher used LDA to identify topics related to customer perspectives on Segari, which will be communicated to the relevant team. The analysis revealed that some customers are satisfied while others are disappointed with the product delivery process, application, prices, promotions, and vouchers. Customers generally expressed satisfaction with the quality and freshness of the products. Some customers felt disappointed due to missing or incomplete items in their orders, also to customer service.
AB - Segari is a customer-centric company with a core value of being obsessed with its customers. The lack of human resources and the abundance of customer reviews that need to be analyzed hinder the process of extracting information from these reviews. Therefore, a machine learning model is needed to automatically perform sentiment analysis and topic modeling. The information extracted from sentiment analysis can be used as a reference to maintain service quality based on positive sentiments, while the results of negative sentiments can be used for evaluation to improve Segari's services and application. The data used on this research were customer reviews from the Google Play Store. The model development process includes data collection, data labeling, data preprocessing, feature extraction, sentiment classification model, model evaluation, and topic modeling. The researcher utilized two classification algorithms, NB and SVM, on a total of 10,507 reviews. The data shows that 74.37% express positive sentiments, while 25.63% express negative sentiments. The results of the study indicate that SVM with oversampling achieved the best model performance, with a recall of 89.98%. Additionally, the researcher used LDA to identify topics related to customer perspectives on Segari, which will be communicated to the relevant team. The analysis revealed that some customers are satisfied while others are disappointed with the product delivery process, application, prices, promotions, and vouchers. Customers generally expressed satisfaction with the quality and freshness of the products. Some customers felt disappointed due to missing or incomplete items in their orders, also to customer service.
KW - Customer Reviews
KW - Google Play Store
KW - Segari
KW - Sentiment Analysis
KW - Topic modeling
UR - http://www.scopus.com/inward/record.url?scp=85181532563&partnerID=8YFLogxK
U2 - 10.1109/ICE3IS59323.2023.10335206
DO - 10.1109/ICE3IS59323.2023.10335206
M3 - Conference contribution
AN - SCOPUS:85181532563
T3 - Proceedings - 2023 3rd International Conference on Electronic and Electrical Engineering and Intelligent System: Responsible Technology for Sustainable Humanity, ICE3IS 2023
SP - 13
EP - 18
BT - Proceedings - 2023 3rd International Conference on Electronic and Electrical Engineering and Intelligent System
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 9 August 2023 through 10 August 2023
ER -