Label selection of inflectional word gestures for indonesian sign system known as SIBI (sistem isyarat bahasa Indonesia)

Sistem Isyarat Bahasa Indonesia (abbreviated as SIBI) is a sign language that follows Indonesian grammatical rules. SIBI has two components in its application, namely the component gesture for giving meaning (hand gesture) and the component gesture to support the meaning (lip motion). In previous study, it was demonstrated that lip motion as the component gesture to support the meaning has low accuracy in determining prefix (21.64%), root word (23.87%) and suffix (22.61%). This is because the lip motion follows data label that relies on the hand gesture instead. Therefore, this study tried to select the appropriate data label by conducting experiments using skeleton, hand and lip features and labeling that refers to hand gesture and lip motion. The largest accuracy difference obtained from experiments conducted for skeleton, hand, and lip features were on the root words, denoting (36.76%), (23.36%), and (17.33%), respectively. From these differences, it was found that the most suitable of the data label for SIBI inflectional word is the hand gesture. Nevertheless, the accuracy of lip feature using lip motion label is better than the lip feature using hand gesture label; moreover, the skeleton feature and hand feature using hand gesture label are better than the same feature using lip motion label.