Experimental Evaluation of Pothole Detection and Its Dimension Estimation Using YOLOv8 and Depth Camera for Road Surface Analysis

Henry Widodo, Heru Taufiqurrohman, Abdul Muis, Yusuf Nur Wijayanto, Galuh Prihantoro, Hanifah Dwiyanti, Zaid Cahya, Afif Widaryanto, Tsani Hendro Nugroho

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Pothole detection and dimension estimation are essential to improve the safety and comfort of autonomous vehicles. This paper uses a depth camera to present a new approach for position estimation and pothole detection using the You Only Look Once (YOLO) method. Experimental results on detection applications using real cars show good pothole detection accuracy in both bright and dimly lit road conditions covered by trees with precision. This object detection uses the YOLO version 8 nano model accompanied by coco as pre-trained training. In the training dataset, only one class, namely the pothole dataset, is used. A depth camera from Intel Realsense type D455 will be employed, and the Jetson Orin Nano will subsequently apply the training results. During the field test, data about the position of the pothole coordinate inside the pixel frame, the pothole's width, and its distance from the camera will be displayed, in addition to pothole-detecting objects. Every pothole object found will have its data shown in real time. Validating the width and length of the pothole involves taking actual measurements with a meter. The estimated distance and width of potholes showed good agreement with direct manual measurements with R -squared values above 0.97 and gradients approaching unity.

Original languageEnglish
Title of host publicationProceeding - 2024 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, ICRAMET 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages339-344
Number of pages6
ISBN (Electronic)9798350389920
DOIs
Publication statusPublished - 2024
Event13th International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, ICRAMET 2024 - Virtual, Online
Duration: 12 Nov 202413 Nov 2024

Publication series

NameProceeding - 2024 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, ICRAMET 2024

Conference

Conference13th International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, ICRAMET 2024
CityVirtual, Online
Period12/11/2413/11/24

Keywords

  • autonomous vehicle
  • pothole detection
  • pothole distance
  • pothole width
  • road surface
  • unstructured path

Fingerprint

Dive into the research topics of 'Experimental Evaluation of Pothole Detection and Its Dimension Estimation Using YOLOv8 and Depth Camera for Road Surface Analysis'. Together they form a unique fingerprint.

Cite this