TY - GEN
T1 - Road Damage Dataset Evaluation Using YOLOv8 for Road Inspection System
AU - Mulyanto, Agus
AU - Sari, Riri Fitri
AU - Muis, Abdul
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - The ASTM D6433-18 standard is widely used internationally in the Road Inspection System (RIS) to assess pavement distress, covering type, severity, and quantity. Automated detection of pavement distress types using vision-based methods follows these standards and requires a dataset with 19 types of pavement distress. The Road Damage Dataset (RDD) 2018 is a publicly available collection comprising 9,053 images captured on Japanese roads, each annotated with eight distinct types of road damage. However, only four of these classifications align with the categories specified in ASTM standards, namely alligator cracking, joint-reflection cracking, longitudinal and transverse cracking, and potholes. This article aims to assess the viability of utilizing the RDD dataset for Road Inspection System (RIS) purposes in accordance with the ASTM D6433-18 standard. The methodology involves the automated re-annotation of the dataset utilizing YOLOv8 models known as pseudo-labeling, followed by an evaluation to ascertain its compatibility with RIS requirements. The results suggest that the RDD-18 dataset is not suitable for conducting RIS in adherence to the ASTM D6433-18 standard. The evaluation results demonstrate less-than-optimal accuracy, which is attributed to an imbalanced distribution of instances among classes and a requirement for improved image quality. Finally, it is highlighted that the RDD 2018 dataset lacks images representing 15 additional types of pavement distress crucial for RIS applications based on ASTM standards.
AB - The ASTM D6433-18 standard is widely used internationally in the Road Inspection System (RIS) to assess pavement distress, covering type, severity, and quantity. Automated detection of pavement distress types using vision-based methods follows these standards and requires a dataset with 19 types of pavement distress. The Road Damage Dataset (RDD) 2018 is a publicly available collection comprising 9,053 images captured on Japanese roads, each annotated with eight distinct types of road damage. However, only four of these classifications align with the categories specified in ASTM standards, namely alligator cracking, joint-reflection cracking, longitudinal and transverse cracking, and potholes. This article aims to assess the viability of utilizing the RDD dataset for Road Inspection System (RIS) purposes in accordance with the ASTM D6433-18 standard. The methodology involves the automated re-annotation of the dataset utilizing YOLOv8 models known as pseudo-labeling, followed by an evaluation to ascertain its compatibility with RIS requirements. The results suggest that the RDD-18 dataset is not suitable for conducting RIS in adherence to the ASTM D6433-18 standard. The evaluation results demonstrate less-than-optimal accuracy, which is attributed to an imbalanced distribution of instances among classes and a requirement for improved image quality. Finally, it is highlighted that the RDD 2018 dataset lacks images representing 15 additional types of pavement distress crucial for RIS applications based on ASTM standards.
KW - ASTM D6433-18
KW - Pseudo-labeling
KW - RDD-2018
KW - Road Inspection System (RIS)
KW - YOLOv8
UR - http://www.scopus.com/inward/record.url?scp=85198343213&partnerID=8YFLogxK
U2 - 10.1109/ICCAE59995.2024.10569208
DO - 10.1109/ICCAE59995.2024.10569208
M3 - Conference contribution
AN - SCOPUS:85198343213
T3 - 2024 16th International Conference on Computer and Automation Engineering, ICCAE 2024
SP - 403
EP - 407
BT - 2024 16th International Conference on Computer and Automation Engineering, ICCAE 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 16th International Conference on Computer and Automation Engineering, ICCAE 2024
Y2 - 14 March 2024 through 16 March 2024
ER -