Enhancing argumentation component classification using contextual language model

Hidayaturrahman, Emmanuel Dave, Derwin Suhartono, Aniati Murni Arymurthy

Research output: Contribution to journalArticlepeer-review

Abstract

Arguments facilitate humans to deliver their ideas. The outcome of the discussion heavily relies on the validity of the argument. If an argument is well-composed, it is more effective to grasp the core idea behind the argument. To grade the argument, machines can be utilized by decomposing into semantic label components. In natural language processing, multiple language models are available to perform this task. It is divided into context-free and contextual models. The majority of previous studies used hand-crafted features to perform argument component classification, while state of the art language models utilize machine learning. The majority of these language models ignore the context in an argument. This research paper aims to analyze whether by including the context in the classification process may improve the accuracy of the language model which will enhance the argumentation mining process as well. The same document corpus is fed into several language models. Word2Vec and GLoVe represent the context free models, while BERT and ELMo as context sensitive language models. Accuracy and time from each model are then compared to determine the importance of context. The result shows that contextual language models are proven to be able to boost classification accuracy by approximately 20%. However, time comes as a cost where contextual models require longer training and prediction time. The benefit from the increase in accuracy outweighs the burden of time. Thus, as a contextual task, argumentation mining is suggested to use contextual model where context must be included to achieve promising results.

Original languageEnglish
Article number103
JournalJournal of Big Data
Volume8
Issue number1
DOIs
Publication statusPublished - Dec 2021

Keywords

  • Argumentation mining
  • BERT
  • Context free model
  • Contextual model
  • ELMo
  • GloVe
  • Language model
  • Word2Vec

Fingerprint

Dive into the research topics of 'Enhancing argumentation component classification using contextual language model'. Together they form a unique fingerprint.

Cite this