Lambda-based data processing architecture for two-level load forecasting in residential buildings

Gde Dharma Nugraha, Ardiansyah Musa, Jaiyoung Cho, Kishik Park, Deokjai Choi

Research output: Contribution to journalArticlepeer-review

19 Citations (Scopus)


Building energy management systems (BEMS) have been intensively used to manage the electricity consumption of residential buildings more efficiently. However, the dynamic behavior of the occupants introduces uncertainty problems that affect the performance of the BEMS. To address this uncertainty problem, the BEMS may implement load forecasting as one of the BEMS modules. Load forecasting utilizes historical load data to compute model predictions for a specific time in the future. Recently, smart meters have been introduced to collect electricity consumption data. Smart meters not only capture aggregation data, but also individual data that is more frequently close to real-time. The processing of both smart meter data types for load forecasting can enhance the performance of the BEMS when confronted with uncertainty problems. The collection of smart meter data can be processed using a batch approach for short-term load forecasting, while the real-time smart meter data can be processed for very short-term load forecasting, which adjusts the short-term load forecasting to adapt to the dynamic behavior of the occupants. This approach requires different data processing techniques for aggregation and individual of smart meter data. In this paper, we propose Lambda-based data processing architecture to process the different types of smart meter data and implement the two-level load forecasting approach, which combines short-term and very short-term load forecasting techniques on top of our proposed data processing architecture. The proposed approach is expected to enhance the BEMS to address the uncertainty problem in order to process data in less time. Our experiment showed that the proposed approaches improved the accuracy by 7% compared to a typical BEMS with only one load forecasting technique, and had the lowest computation time when processing the smart meter data.

Original languageEnglish
Article number772
Issue number4
Publication statusPublished - Apr 2018


  • Building energy management systems (BEMS)
  • Lambda architecture
  • Load forecasting
  • Scheduler
  • Short-term load forecasting (STLF)
  • Two-level load forecasting


Dive into the research topics of 'Lambda-based data processing architecture for two-level load forecasting in residential buildings'. Together they form a unique fingerprint.

Cite this