Text-Driven Talking Head Using Dynamic Viseme and DFFD for SIBI

Sultan Muzahidin, Erdefi Rakun

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This research aims to build an android application that is able to help a deaf person in learning the Indonesian Sign Language System (SIBI). The application is packaged in the form of a 3D animated talking head. This research, the development of a talking head uses the dynamic viseme method. Dynamic viseme has the advantage of creating a more natural animation movement because it uses the original human model in the building process. By using the Dirichlet Free-Form Deformation (DFFD) method as control, the concatenative method is able to produce animated movements that are easily understood by the deaf person. In its build, linear interpolation was also used so that the displacement in the speaker becomes more natural. To build animated movements, four different human models were used. Experimental testing was carried out using surveys and calculations were carried out using the Mean Opinion Score (MOS) method. The number of surveys carried out was five. The purpose of the survey is to determine a model that is easier to understand by mouth movements. The test results on the Indonesian sentence show a value of 4.25. These results indicate that the 3D talking head has the potential to be developed so that it can be understood by a deaf person.

Original languageEnglish
Title of host publication7th International Conference on Information Technology, Computer, and Electrical Engineering, ICITACEE 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages173-178
Number of pages6
ISBN (Electronic)9781728172255
DOIs
Publication statusPublished - 24 Sep 2020
Event7th International Conference on Information Technology, Computer, and Electrical Engineering, ICITACEE 2020 - Semarang, Indonesia
Duration: 24 Sep 202025 Sep 2020

Publication series

Name7th International Conference on Information Technology, Computer, and Electrical Engineering, ICITACEE 2020 - Proceedings

Conference

Conference7th International Conference on Information Technology, Computer, and Electrical Engineering, ICITACEE 2020
Country/TerritoryIndonesia
CitySemarang
Period24/09/2025/09/20

Keywords

  • 3D animation
  • DFFD
  • dynamic viseme
  • SIBI
  • talking head

Fingerprint

Dive into the research topics of 'Text-Driven Talking Head Using Dynamic Viseme and DFFD for SIBI'. Together they form a unique fingerprint.

Cite this