Feature Extraction from Smartphone Images by Using Elliptical Fourier Descriptor, Centroid and Area for Recognizing Indonesian Sign Language SIBI (Sistem Isyarat Bahasa Indonesia)

Mohamad Harits Nur Fauzan, Erdefi Rakun, Dadan Hardianto

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Sistem Isyarat Bahasa Indonesia (SIBI) is the official sign language in Indonesia. This research aims to create a translator for SIBI to be installed on a smartphone. The translator will analyze gestures for inflectional words, which are root words combined with prefixes, and/or suffixes. The feature extraction method that was used in this research is Elliptical Fourier Descriptor (EFD), additionally centroid and area data were added to retain information on hand orientation, position and shape. The extracted features will be fed into, a Long Short-Term Memory (LSTM) model which will then recognize gestures into text. The method used in this research produced 99% accuracy for root word gestures, 71% accuracy for prefix gestures, 86% accuracy for suffix gestures.

Original languageEnglish
Title of host publicationProceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages8-14
Number of pages7
ISBN (Electronic)9781728126623
DOIs
Publication statusPublished - 1 Feb 2019
Event2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019 - Singapore, Singapore
Duration: 28 Feb 20192 Mar 2019

Publication series

NameProceedings - 2019 2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019

Conference

Conference2nd International Conference on Intelligent Autonomous Systems, ICoIAS 2019
Country/TerritorySingapore
CitySingapore
Period28/02/192/03/19

Keywords

  • computer vision
  • deep learning
  • feature extraction
  • image processing
  • machine learning
  • sign language

Fingerprint

Dive into the research topics of 'Feature Extraction from Smartphone Images by Using Elliptical Fourier Descriptor, Centroid and Area for Recognizing Indonesian Sign Language SIBI (Sistem Isyarat Bahasa Indonesia)'. Together they form a unique fingerprint.

Cite this