BERT-based combination of convolutional and recurrent neural network for indonesian sentiment analysis

Hendri Murfi, Syamsyuriani, Theresia Gowandi, Gianinna Ardaneswari, Siti Nurrohmah

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Sentiment analysis is the computational study of opinions and emotions expressed in text. Deep learning is a model that is currently producing state-of-the-art in various application domains, including sentiment analysis. Many researchers are using a hybrid approach that combines different deep learning models and has been shown to improve model performance. In sentiment analysis, input in text data is first converted into a numerical representation. The standard method used to obtain a text representation is the fine-tuned embedding method. However, this method does not pay attention to each word's context in the sentence. Therefore, the Bidirectional Encoder Representation from Transformer (BERT) model is used to obtain text representations based on the context and position of words in sentences. This research extends the previous hybrid deep learning using BERT representation for Indonesian sentiment analysis. Our simulation shows that the BERT representation improves the accuracies of all hybrid architectures. The BERT-based LSTM-CNN also reaches slightly better accuracies than other BERT-based hybrid architectures.

Original languageEnglish
Article number111112
JournalApplied Soft Computing
Volume151
DOIs
Publication statusPublished - Jan 2024

Keywords

  • BERT
  • Deep learning
  • Hybrid deep learning
  • Sentiment analysis
  • Text representation

Fingerprint

Dive into the research topics of 'BERT-based combination of convolutional and recurrent neural network for indonesian sentiment analysis'. Together they form a unique fingerprint.

Cite this