Big data analysis architecture for multi IDS sensors using memory based processor

Ferry Astika Saputra, Muhammad Salman, Kalamullah Ramli, Abid Abdillah, Iwan Syarif

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

The massive internet usage is followed by the rise of cyber-related crime such as information stealing, denial-of-service (DoS) attack, trojan and malware. To cope with the threats, one of most popular choice is using Intrusion Detection System (IDS). The logs produced by IDS in a day is huge and the limitation of computing power is the main problem to process that logs files. In this paper, we propose a big data analysis architecture of multi IDS sensors using in-memory data processing. Deployed IDS sensors are taking an extra role as computation slave to build scalable data analysis platform for network security analysis. So, adding more sensors means expanding computational resources. Adding to three sensors are helping data computation of clustering algorithm faster up to 27% comparing to the computation by using only one sensor. This research also introduces the use of memory-based processor, this system provides 7,9 times faster data processing than conservative MapReduce operation. And moreover, we also have performed botnets classification over Spark RDD that give high accuracy result to 99%.

Original languageEnglish
Title of host publicationProceedings - International Electronics Symposium on Knowledge Creation and Intelligent Computing, IES-KCIC 2017
EditorsFahim Nur Cahya Bagar, Ahmad Zainudin, M. Udin Harun Al Rasyid, Hendy Briantoro, Zulhaydar Fairozal Akbar
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-45
Number of pages6
ISBN (Electronic)9781538607169
DOIs
Publication statusPublished - 19 Dec 2017
Event6th International Electronics Symposium on Knowledge Creation and Intelligent Computing, IES-KCIC 2017 - Surabaya, Indonesia
Duration: 26 Sep 201727 Sep 2017

Publication series

NameProceedings - International Electronics Symposium on Knowledge Creation and Intelligent Computing, IES-KCIC 2017
Volume2017-January

Conference

Conference6th International Electronics Symposium on Knowledge Creation and Intelligent Computing, IES-KCIC 2017
Country/TerritoryIndonesia
CitySurabaya
Period26/09/1727/09/17

Keywords

  • big data architecture
  • Intrusion detection system
  • Memory-based Processor
  • network data analysis

Fingerprint

Dive into the research topics of 'Big data analysis architecture for multi IDS sensors using memory based processor'. Together they form a unique fingerprint.

Cite this