Visual information and kinesthetics in virtual manufacturing simulation

Gandjar Kiswanto; Adjeng Ayu Setiani; Ferdiansyah Zhultriza; Dody Rakhmat Ramadhan; Muhammad Fathin Juzar; Rachmad Muhammad Suryantoro; Radon Dhelika

doi:10.1063/5.0001059

Visual information and kinesthetics in virtual manufacturing simulation

Gandjar Kiswanto, Adjeng Ayu Setiani, Ferdiansyah Zhultriza, Dody Rakhmat Ramadhan, Muhammad Fathin Juzar, Rachmad Muhammad Suryantoro, Radon Dhelika

Department of Mechanical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This research aims to design and assemble complex parts using wearable sensor data, image processing data and integration of Application Programming Interface of 3D CAD system. Experiments were conducted to improve users' experience to have both kinesthetic and visual interaction with virtual objects. Input data from muscle contraction as well as hand image processing are fed with the data from an Electromyogram (EMG) sensor. This allows virtual objects to be grasped, moved and dropped through muscle force classification based on physical world masses. From the results of this research, the combination of wearable sensor and image processing as an instruction input for virtual manufacturing successfully enhance users' interaction experiences with virtual objects addressed in a touchless manner.

Original language	English
Title of host publication	Recent Progress on
Subtitle of host publication	Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019
Editors	Nahry, Dwinanti Rika Marthanty
Publisher	American Institute of Physics Inc.
ISBN (Electronic)	9780735419865
DOIs	https://doi.org/10.1063/5.0001059
Publication status	Published - 6 May 2020
Event	16th International Conference on Quality in Research, QiR 2019 - 2019 International Symposium on Advances in Mechanical Engineering, ISAME 2019 - Padang, Indonesia Duration: 22 Jul 2019 → 24 Jul 2019

Publication series

Name	AIP Conference Proceedings
Volume	2227
ISSN (Print)	0094-243X
ISSN (Electronic)	1551-7616

Conference

Conference	16th International Conference on Quality in Research, QiR 2019 - 2019 International Symposium on Advances in Mechanical Engineering, ISAME 2019
Country/Territory	Indonesia
City	Padang
Period	22/07/19 → 24/07/19

Access to Document

10.1063/5.0001059

Cite this

Kiswanto, G., Setiani, A. A., Zhultriza, F., Ramadhan, D. R., Juzar, M. F., Suryantoro, R. M., & Dhelika, R. (2020). Visual information and kinesthetics in virtual manufacturing simulation. In Nahry, & D. R. Marthanty (Eds.), Recent Progress on: Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019 Article 020039 (AIP Conference Proceedings; Vol. 2227). American Institute of Physics Inc.. https://doi.org/10.1063/5.0001059

Kiswanto, Gandjar ; Setiani, Adjeng Ayu ; Zhultriza, Ferdiansyah et al. / Visual information and kinesthetics in virtual manufacturing simulation. Recent Progress on: Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019. editor / Nahry ; Dwinanti Rika Marthanty. American Institute of Physics Inc., 2020. (AIP Conference Proceedings).

@inproceedings{5202a8314225426bb52db7ef60b0b4b8,

title = "Visual information and kinesthetics in virtual manufacturing simulation",

abstract = "This research aims to design and assemble complex parts using wearable sensor data, image processing data and integration of Application Programming Interface of 3D CAD system. Experiments were conducted to improve users' experience to have both kinesthetic and visual interaction with virtual objects. Input data from muscle contraction as well as hand image processing are fed with the data from an Electromyogram (EMG) sensor. This allows virtual objects to be grasped, moved and dropped through muscle force classification based on physical world masses. From the results of this research, the combination of wearable sensor and image processing as an instruction input for virtual manufacturing successfully enhance users' interaction experiences with virtual objects addressed in a touchless manner. ",

author = "Gandjar Kiswanto and Setiani, {Adjeng Ayu} and Ferdiansyah Zhultriza and Ramadhan, {Dody Rakhmat} and Juzar, {Muhammad Fathin} and Suryantoro, {Rachmad Muhammad} and Radon Dhelika",

note = "Funding Information: This research is financed by PITTA research Grant 2018 Publisher Copyright: {\textcopyright} 2020 Author(s). Copyright: Copyright 2020 Elsevier B.V., All rights reserved.; 16th International Conference on Quality in Research, QiR 2019 - 2019 International Symposium on Advances in Mechanical Engineering, ISAME 2019 ; Conference date: 22-07-2019 Through 24-07-2019",

year = "2020",

month = may,

day = "6",

doi = "10.1063/5.0001059",

language = "English",

series = "AIP Conference Proceedings",

publisher = "American Institute of Physics Inc.",

editor = "Nahry and Marthanty, {Dwinanti Rika}",

booktitle = "Recent Progress on",

address = "United States",

}

Kiswanto, G, Setiani, AA, Zhultriza, F, Ramadhan, DR, Juzar, MF, Suryantoro, RM & Dhelika, R 2020, Visual information and kinesthetics in virtual manufacturing simulation. in Nahry & DR Marthanty (eds), Recent Progress on: Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019., 020039, AIP Conference Proceedings, vol. 2227, American Institute of Physics Inc., 16th International Conference on Quality in Research, QiR 2019 - 2019 International Symposium on Advances in Mechanical Engineering, ISAME 2019, Padang, Indonesia, 22/07/19. https://doi.org/10.1063/5.0001059

Visual information and kinesthetics in virtual manufacturing simulation. / Kiswanto, Gandjar; Setiani, Adjeng Ayu; Zhultriza, Ferdiansyah et al.
Recent Progress on: Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019. ed. / Nahry; Dwinanti Rika Marthanty. American Institute of Physics Inc., 2020. 020039 (AIP Conference Proceedings; Vol. 2227).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Visual information and kinesthetics in virtual manufacturing simulation

AU - Kiswanto, Gandjar

AU - Setiani, Adjeng Ayu

AU - Zhultriza, Ferdiansyah

AU - Ramadhan, Dody Rakhmat

AU - Juzar, Muhammad Fathin

AU - Suryantoro, Rachmad Muhammad

AU - Dhelika, Radon

PY - 2020/5/6

Y1 - 2020/5/6

N2 - This research aims to design and assemble complex parts using wearable sensor data, image processing data and integration of Application Programming Interface of 3D CAD system. Experiments were conducted to improve users' experience to have both kinesthetic and visual interaction with virtual objects. Input data from muscle contraction as well as hand image processing are fed with the data from an Electromyogram (EMG) sensor. This allows virtual objects to be grasped, moved and dropped through muscle force classification based on physical world masses. From the results of this research, the combination of wearable sensor and image processing as an instruction input for virtual manufacturing successfully enhance users' interaction experiences with virtual objects addressed in a touchless manner.

AB - This research aims to design and assemble complex parts using wearable sensor data, image processing data and integration of Application Programming Interface of 3D CAD system. Experiments were conducted to improve users' experience to have both kinesthetic and visual interaction with virtual objects. Input data from muscle contraction as well as hand image processing are fed with the data from an Electromyogram (EMG) sensor. This allows virtual objects to be grasped, moved and dropped through muscle force classification based on physical world masses. From the results of this research, the combination of wearable sensor and image processing as an instruction input for virtual manufacturing successfully enhance users' interaction experiences with virtual objects addressed in a touchless manner.

UR - http://www.scopus.com/inward/record.url?scp=85096402933&partnerID=8YFLogxK

U2 - 10.1063/5.0001059

DO - 10.1063/5.0001059

M3 - Conference contribution

AN - SCOPUS:85096402933

T3 - AIP Conference Proceedings

BT - Recent Progress on

A2 - Nahry, null

A2 - Marthanty, Dwinanti Rika

PB - American Institute of Physics Inc.

T2 - 16th International Conference on Quality in Research, QiR 2019 - 2019 International Symposium on Advances in Mechanical Engineering, ISAME 2019

Y2 - 22 July 2019 through 24 July 2019

ER -

Kiswanto G, Setiani AA, Zhultriza F, Ramadhan DR, Juzar MF, Suryantoro RM et al. Visual information and kinesthetics in virtual manufacturing simulation. In Nahry, Marthanty DR, editors, Recent Progress on: Mechanical, Infrastructure and Industrial Engineering - Proceedings of the International Symposium on Advances in Mechanical Engineering, ISAME 2019: Quality in Research 2019. American Institute of Physics Inc. 2020. 020039. (AIP Conference Proceedings). doi: 10.1063/5.0001059

Visual information and kinesthetics in virtual manufacturing simulation

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this