Fall detection on multimodal dataset using convolutional neural netwok and long short term memory

Dina Chahyati, Rehan Hawari

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Fall is the second leading cause of accidental injury and death worldwide. This event often occurs in the elderly and the frequency is increasing every year. Reliable fall activity detection system can reduce the risk of injuries suffered. Since falls are unwanted events or occur suddenly, it is difficult to collect actual fall data. It is also difficult because of the similarity to some activities such as squatting and picking up objects from the floor. In addition, in recent years the publicly available fall datasets are limited. Therefore, in 2019, some researchers tried to create a comprehensive fall dataset that simulates the actual events using camera and sensor devices. The experiment produced a multimodal dataset UP-Fall. Using this dataset, this work tries to detect falling activity using Convolutional Neural Network and Long Short-Term Memory approaches. CNN is used to detect spatial information from image data, while LSTM is used to exploit temporal information from signal data. Then, the results of the two models are combined with the majority voting strategy. Based on the evaluation results, CNN obtained an accuracy of 98.49% and LSTM 98.88%. Both models contribute to the performance of the majority voting strategy with the result that the accuracy (98.31%) exceeds baseline accuracy (96.4%). Other evaluation metrics also improved such as precision goes up to 11%, recall 14%, and F1-score 12% in comparison with baseline.

Original languageEnglish
Title of host publication2020 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages371-376
Number of pages6
ISBN (Electronic)9781728192796
DOIs
Publication statusPublished - 17 Oct 2020
Event12th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020 - Virtual, Depok, Indonesia
Duration: 17 Oct 202018 Oct 2020

Publication series

Name2020 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020

Conference

Conference12th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020
Country/TerritoryIndonesia
CityVirtual, Depok
Period17/10/2018/10/20

Keywords

  • Convolutional Neural Network
  • Fall
  • Long Short Term Memory
  • Majority voting
  • UP-Fall multimodal dataset

Fingerprint

Dive into the research topics of 'Fall detection on multimodal dataset using convolutional neural netwok and long short term memory'. Together they form a unique fingerprint.

Cite this