Distance variable improvement of time-series big data stream evaluation

Ari Wibisono, Petrus Mursanto, Jihan Adibah, Wendy D.W.T. Bayu, May Iffah Rizki, Lintang Matahari Hasani, Valian Fil Ahli

Research output: Contribution to journalArticlepeer-review

Abstract

Real-time information mining of a big dataset consisting of time series data is a very challenging task. For this purpose, we propose using the mean distance and the standard deviation to enhance the accuracy of the existing fast incremental model tree with the drift detection (FIMT-DD) algorithm. The standard FIMT-DD algorithm uses the Hoeffding bound as its splitting criterion. We propose the further use of the mean distance and standard deviation, which are used to split a tree more accurately than the standard method. We verify our proposed method using the large Traffic Demand Dataset, which consists of 4,000,000 instances; Tennet’s big wind power plant dataset, which consists of 435,268 instances; and a road weather dataset, which consists of 30,000,000 instances. The results show that our proposed FIMT-DD algorithm improves the accuracy compared to the standard method and Chernoff bound approach. The measured errors demonstrate that our approach results in a lower Mean Absolute Percentage Error (MAPE) in every stage of learning by approximately 2.49% compared with the Chernoff Bound method and 19.65% compared with the standard method.

Original languageEnglish
Article number85
JournalJournal of Big Data
Volume7
Issue number1
DOIs
Publication statusPublished - 1 Dec 2020

Keywords

  • Big data regression
  • Data stream
  • Distance improvement
  • Intelligent Systems

Fingerprint Dive into the research topics of 'Distance variable improvement of time-series big data stream evaluation'. Together they form a unique fingerprint.

Cite this