Label selection of inflectional word gestures for indonesian sign system known as SIBI (sistem isyarat bahasa Indonesia)

Keumala Anggraini, Erdefi Rakun

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Sistem Isyarat Bahasa Indonesia (abbreviated as SIBI) is a sign language that follows Indonesian grammatical rules. SIBI has two components in its application, namely the component gesture for giving meaning (hand gesture) and the component gesture to support the meaning (lip motion). In previous study, it was demonstrated that lip motion as the component gesture to support the meaning has low accuracy in determining prefix (21.64%), root word (23.87%) and suffix (22.61%). This is because the lip motion follows data label that relies on the hand gesture instead. Therefore, this study tried to select the appropriate data label by conducting experiments using skeleton, hand and lip features and labeling that refers to hand gesture and lip motion. The largest accuracy difference obtained from experiments conducted for skeleton, hand, and lip features were on the root words, denoting (36.76%), (23.36%), and (17.33%), respectively. From these differences, it was found that the most suitable of the data label for SIBI inflectional word is the hand gesture. Nevertheless, the accuracy of lip feature using lip motion label is better than the lip feature using hand gesture label; moreover, the skeleton feature and hand feature using hand gesture label are better than the same feature using lip motion label.

Original languageEnglish
Title of host publication2020 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages147-154
Number of pages8
ISBN (Electronic)9781728192796
DOIs
Publication statusPublished - 17 Oct 2020
Event12th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020 - Virtual, Depok, Indonesia
Duration: 17 Oct 202018 Oct 2020

Publication series

Name2020 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020

Conference

Conference12th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2020
CountryIndonesia
CityVirtual, Depok
Period17/10/2018/10/20

Keywords

  • Data label
  • Hand feature
  • Hand gesture
  • Lip feature
  • Lip motion
  • Skeleton feature

Fingerprint Dive into the research topics of 'Label selection of inflectional word gestures for indonesian sign system known as SIBI (sistem isyarat bahasa Indonesia)'. Together they form a unique fingerprint.

Cite this