Implementation of Single Shot Detector (SSD) MobileNet V2 on Disabled Patient's Hand Gesture Recognition as a Notification System

Annisaa F. Nurfirdausi, Santoso Soekirno, Siti Aminah

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The development of smart healthcare system has a potential to improve the quality of health services. Disabled patients need to express their needs non-verbally to their families or medical workers to fulfill their needs immediately. In this study, we developed hand gesture recognition using web camera as a notification system. Image acquisition was done on 12 subjects with various gender and ages. Based on human's basic daily needs, there are 5 gestures as the object of study: need to eat, need to drink, need to go to the toilet, need help and need medicines. The collected images were trained using Single Shot Detector (SSD) algorithm on MobileNet V2 architecture. Among the various deep learning techniques, SSD MobileNet V2 was chosen because it has good ability in object detection and needs low computation. Therefore, it is suitable to be applied on realtime detection. This study results on mean Average Precision (mAP) 44.7% and detection rate 85% which means 85 out of 100 images were well-detected. The mAP showed better result than previous studies. Frame rate per second (FPS) provided in this study was ±2 FPS. The gestures detected also triggered the notification on telegram to notify family or nurse who take care of disabled patients.

Original languageEnglish
Title of host publication2021 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665442640
DOIs
Publication statusPublished - 2021
Event13th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2021 - Depok, Indonesia
Duration: 23 Oct 202126 Oct 2021

Publication series

Name2021 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2021

Conference

Conference13th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2021
Country/TerritoryIndonesia
CityDepok
Period23/10/2126/10/21

Keywords

  • deep learning
  • disabled patient communication
  • hand gesture recognition
  • single shot detector mobilenet v2
  • smart healthcare system

Fingerprint

Dive into the research topics of 'Implementation of Single Shot Detector (SSD) MobileNet V2 on Disabled Patient's Hand Gesture Recognition as a Notification System'. Together they form a unique fingerprint.

Cite this