TY - GEN
T1 - Big sensor-generated data streaming using Kafka and Impala for data storage in Wireless Sensor Network for CO2 monitoring
AU - Wiska, Rindra
AU - Habibie, Novian
AU - Wibisono, Ari
AU - Nugroho, Widijanto Satyo
AU - Mursanto, Petrus
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2017/3/6
Y1 - 2017/3/6
N2 - Wireless Sensor Network (WSN) is a system that have a capability to conduct data acquisition and monitoring in a wide sampling area for a long time. However, because of its big-scale monitoring, amount of data accumulated from WSN is very huge. Conventional database system may not be able to handle its big amount of data. To overcome that, big data approach is used for an alternative data storage system and data analysis process. This research developed a WSN system for CO2 monitoring using Kafka and Impala to distribute a huge amount of data. Sensor nodes gather data and accumulated in temporary storage then streamed via Kafka platform to be stored into Impala database. System tested with data gathered from our-own made sensor nodes and give a good performance.
AB - Wireless Sensor Network (WSN) is a system that have a capability to conduct data acquisition and monitoring in a wide sampling area for a long time. However, because of its big-scale monitoring, amount of data accumulated from WSN is very huge. Conventional database system may not be able to handle its big amount of data. To overcome that, big data approach is used for an alternative data storage system and data analysis process. This research developed a WSN system for CO2 monitoring using Kafka and Impala to distribute a huge amount of data. Sensor nodes gather data and accumulated in temporary storage then streamed via Kafka platform to be stored into Impala database. System tested with data gathered from our-own made sensor nodes and give a good performance.
UR - http://www.scopus.com/inward/record.url?scp=85016951148&partnerID=8YFLogxK
U2 - 10.1109/IWBIS.2016.7872896
DO - 10.1109/IWBIS.2016.7872896
M3 - Conference contribution
AN - SCOPUS:85016951148
T3 - 2016 International Workshop on Big Data and Information Security, IWBIS 2016
SP - 97
EP - 101
BT - 2016 International Workshop on Big Data and Information Security, IWBIS 2016
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2016 International Workshop on Big Data and Information Security, IWBIS 2016
Y2 - 18 October 2016 through 19 October 2016
ER -