Sign language system for Bahasa Indonesia (Known as SIBI) recognizer using TensorFlow and long short-term memory

Kustiawanto Halim, Erden Rakun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

SIBI is used formally as a Sign Langnage System for Bahasa Indonesia. SIBI follows Bahasa Indonesia's grammatical structure, which makes it a unique and complex Sign Language System. The state of current research in SIBI is that it is possible to translate the alphabet, root words and numbers to text. This research focuses in recognizing inflectional words, which are root words and combination of prefix, infix and suffix. By separating the root words, prefix, infix and suffix, it was possible to use minimal feature sets. SIBI sequence data contains temporal dependencies, therefore Long Short-Term Memory (LSTM) is chosen as the machine learning model to use on this problem. The entire sequence of feature sets based on the SIBI inflectional word gestures is used as input TensorFlow is used as development framework to make sure model can be easily deployed to a variety of devices, including smartphone». The best results were obtained using a 2-layer LSTM with 96.15% of accuracy for root words. The same model obtained an accuracy score of 78-38% with Inflectional words. The model, however, still struggles in recognizing prefixes and suffixes correctly.

Original languageEnglish
Title of host publication2018 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages403-407
Number of pages5
ISBN (Electronic)9781728101354
DOIs
Publication statusPublished - 17 Jan 2019
Event10th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018 - Yogyakarta, Indonesia
Duration: 27 Oct 201828 Oct 2018

Publication series

Name2018 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018

Conference

Conference10th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018
CountryIndonesia
CityYogyakarta
Period27/10/1828/10/18

Keywords

  • LSTM
  • Recurrent Neural Network
  • SIBI
  • Sign Language
  • Smartphone
  • TensorFlow

Fingerprint Dive into the research topics of 'Sign language system for Bahasa Indonesia (Known as SIBI) recognizer using TensorFlow and long short-term memory'. Together they form a unique fingerprint.

  • Cite this

    Halim, K., & Rakun, E. (2019). Sign language system for Bahasa Indonesia (Known as SIBI) recognizer using TensorFlow and long short-term memory. In 2018 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018 (pp. 403-407). [8618134] (2018 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICACSIS.2018.8618134