YOLOv4 RGBT Human Detection on Unmanned Aerial Vehicle Perspective

Putri Shaniya, Grafika Jati, Machmud Roby Alhamidi, Wahyu Caesarendra, Wisnu Jatmiko

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Analysis of visual drone images in various domains is increasing due to its ability to see the object from different perspectives and certain distant. Nowadays, small object detection from drones images is expected to overcome various environmental challenges such as illumination and motion change. Thermal infrared in addition to RGB images (RGBT) appears to undertake these challenges. Research on how this combination can give the best performance in object detection is still become attractive problem to be solved. In this study, The state of the art in object detection You Only Look Once (YOLO) v4 performance has been demonstrated by conducted three scenarios training methods in both RGB and thermal infrared (TIR) images dataset with unmanned aerial vehicle (UAV) perspective view. The dataset has been manually annotated to be compatible in YOLO format and the annotation will be release to the community. The pre-trained YOLO weight with minimal fine tuning also has been utilized to determine the transfer learning influence on the new aerial perspective dataset. The experimental result shows that with pre-trained model transfer learning from MS COCO dataset can improved the YOLOv4 human detection with Average Precision (AP) up to 91.18 % and 78.24 % in RGB and TIR dataset, respectively.

Original languageEnglish
Title of host publicationProceedings - IWBIS 2021
Subtitle of host publication6th International Workshop on Big Data and Information Security
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages41-46
Number of pages6
ISBN (Electronic)9781665424516
DOIs
Publication statusPublished - 2021
Event6th International Workshop on Big Data and Information Security, IWBIS 2021 - Virtual, Online, Indonesia
Duration: 23 Oct 202126 Oct 2021

Publication series

NameProceedings - IWBIS 2021: 6th International Workshop on Big Data and Information Security

Conference

Conference6th International Workshop on Big Data and Information Security, IWBIS 2021
Country/TerritoryIndonesia
CityVirtual, Online
Period23/10/2126/10/21

Keywords

  • Human detection
  • RGBT
  • small object
  • UAV
  • YOLO

Fingerprint

Dive into the research topics of 'YOLOv4 RGBT Human Detection on Unmanned Aerial Vehicle Perspective'. Together they form a unique fingerprint.

Cite this