TY - JOUR
T1 - Recall, Precision, and F-Measure for Evaluating Information Retrieval System in Electronic Document Management Systems (EDMS)
AU - Sadeli, Annisa Fajriyati
AU - Lawanda, Ike Iswary
PY - 2023/11/17
Y1 - 2023/11/17
N2 - The Legal Division of PT. ABC has implemented EDMS using the Integrated Legal Document Management Application, Centralized Legal Administration System (CLAS), to make the management of documents more accessible. The urgency is the system's accuracy in retrieving data or document input. The study employed a quantitative method with an experimental approach. Data collection techniques were observation, application search tests, documentation, and literature. Data analysis regarding the recall, precision, and F-measure calculation formulas will be compared with the standard information retrieval system effectiveness. The calculation results show that the average recall value for the search equals 1 or 100%. For the precision value that uses quotation marks, it is equal to 0.9713, while for searching without quotation marks, it is equal to 0.3920. From these results, the precision value is lower than the recall value. The precision value of 0.9713 is in the range of 0.68–1.00, which is placed as high precision, meaning that information retrieval is effective. The F-measure value is 0.98, close to 1, so the tracing system is sound. CLAS is quite effective in retrieving information according to user needs.
AB - The Legal Division of PT. ABC has implemented EDMS using the Integrated Legal Document Management Application, Centralized Legal Administration System (CLAS), to make the management of documents more accessible. The urgency is the system's accuracy in retrieving data or document input. The study employed a quantitative method with an experimental approach. Data collection techniques were observation, application search tests, documentation, and literature. Data analysis regarding the recall, precision, and F-measure calculation formulas will be compared with the standard information retrieval system effectiveness. The calculation results show that the average recall value for the search equals 1 or 100%. For the precision value that uses quotation marks, it is equal to 0.9713, while for searching without quotation marks, it is equal to 0.3920. From these results, the precision value is lower than the recall value. The precision value of 0.9713 is in the range of 0.68–1.00, which is placed as high precision, meaning that information retrieval is effective. The F-measure value is 0.98, close to 1, so the tracing system is sound. CLAS is quite effective in retrieving information according to user needs.
KW - Information retrieval
KW - recall
KW - precision
KW - F-measure
UR - https://journal.uin-alauddin.ac.id/index.php/khizanah-al-hikmah/article/view/40335
U2 - 10.24252/kah.v11i2a8
DO - 10.24252/kah.v11i2a8
M3 - Article
SN - 2354-9629
VL - 11
SP - 231
EP - 241
JO - Khizanah al-Hikmah : Jurnal Ilmu Perpustakaan, Informasi, dan Kearsipan
JF - Khizanah al-Hikmah : Jurnal Ilmu Perpustakaan, Informasi, dan Kearsipan
IS - 2
ER -