Particle filter for 3D fingertips tracking from color and depth images with occlusion handling

Derry Alamsyah, Mohamad Ivan Fanany

Research output: Contribution to conferencePaperpeer-review

4 Citations (Scopus)

Abstract

This paper presents a fingertips tracking system based on particle filter using Microsoft Kinect. The tracking is performed in two separate modules: image-based 2D position tracking and calibrated 1D depth tracking. The two modules is then combined to represent full 3D fingertips tracking. The separation is aimed for faster tracking by putting as most processing as possible in 2D while 3D position is obtained by just incorporating available depth information. Moreover, the error in 2D tracking can be corrected using the information from depth tracking and vice-versa. The fingertips are obtained by 2D convex hull algorithm on binary images which is extracted after setting a depth threshold. This assumes that hand and fingers is the foremost part of object nearest to camera during interaction. To deal with partial occlusion, we devised a simple retrace algorithm based on linear time-series analysis of fingertips trajectory. To evaluate the effectiveness of the system we design several scenarios involving contactless user interaction for zooming and motion capture for 3D animation creation. The evaluation is measured in terms of tracking accuracy and overhead computation. The 2D+1D tracking is experimentally shown to be more robust to occlusion with reasonably little overhead computation time.

Original languageEnglish
Pages445-449
Number of pages5
DOIs
Publication statusPublished - 1 Jan 2013
Event2013 5th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2013 - Bali, Indonesia
Duration: 28 Sep 201329 Sep 2013

Conference

Conference2013 5th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2013
Country/TerritoryIndonesia
CityBali
Period28/09/1329/09/13

Fingerprint

Dive into the research topics of 'Particle filter for 3D fingertips tracking from color and depth images with occlusion handling'. Together they form a unique fingerprint.

Cite this