SIMPLE: SISTIM PENILAI ESEI OTOMATIS UNTUK MENILAI UJIAN DALAM BAHASA INDONESIA

Anak Agung Putri Ratna; Bagio Budiardjo; Djoko Hartanto

doi:10.7454/mst.v11i1.435

SIMPLE: SISTIM PENILAI ESEI OTOMATIS UNTUK MENILAI UJIAN DALAM BAHASA INDONESIA

Translated title of the contribution: SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination

Anak Agung Putri Ratna, Bagio Budiardjo, Djoko Hartanto

Department of Electrical Engineering

Research output: Contribution to journal › Article › peer-review

Abstract

SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination. Evaluation of study of a student is a very important aspect of an educational process. Evaluation is aimed at measuring the level of student understanding of the given lecture materials. Measuring student understanding of the course material, using essay-type exam, is generally used as the evaluation tool. In this essay-type exam, the student has to answer questions using sentences, whereby choices of possible answers are not indicated. The student has to answer the questions with his/her sentences. The answers may vary, since it reflects the student’s best thoughts of the materials. One of the weaknesses of essay-type exam is the difficulty to grade the answers and it tends to be time consuming. Currently, automatic grading systems that may speed up the grading process, are being developed in many research institutions. The method used to grade, varies form one system to another, and one of the popular system is the Latent Semantic Analysis (LSA). LSA is a method of grading essay by extracting words and representing the sentence in the form of mathematical or statistical formulation, from a text with a relatively large number of words. The grade of the essay is determined, by matching the important words to a group of words prepared by the human rater. This paper describes an effort to developed LSA, enhanced with word weighting, word order and the word synonym to improve the accuracy of grading. This system is called SIMPLE. SIMPLE is used to grade answers using bahasa Indonesia. The exam is carried out on-line through the Web. From the experiments conducted, for small classes, the conformity of grade compared to the grade of human rater lies between 69.80 % – 94.64 %, and for medium size classes the conformity lies between 77.18 % - 98.42 % with the human rater. These results are roughly proportional with the result of LSA system, which grade essay given in English.

Translated title of the contribution	SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination
Original language	Indonesian
Pages (from-to)	5-11
Journal	MAKARA Journal of Technology Series
Volume	11
Issue number	1
DOIs	https://doi.org/10.7454/mst.v11i1.435
Publication status	Published - 1 Apr 2007

Keywords

SIMPLE
latent semantic analysis
on-line examination
web

Access to Document

10.7454/mst.v11i1.435

https://scholarhub.ui.ac.id/context/mjt/article/1078/viewcontent

Cite this

@article{d2dcf5a1f7574bc0b45e9c74efa2e5ee,

title = "SIMPLE: SISTIM PENILAI ESEI OTOMATIS UNTUK MENILAI UJIAN DALAM BAHASA INDONESIA",

abstract = "SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination. Evaluation of study of a student is a very important aspect of an educational process. Evaluation is aimed at measuring the level of student understanding of the given lecture materials. Measuring student understanding of the course material, using essay-type exam, is generally used as the evaluation tool. In this essay-type exam, the student has to answer questions using sentences, whereby choices of possible answers are not indicated. The student has to answer the questions with his/her sentences. The answers may vary, since it reflects the student{\textquoteright}s best thoughts of the materials. One of the weaknesses of essay-type exam is the difficulty to grade the answers and it tends to be time consuming. Currently, automatic grading systems that may speed up the grading process, are being developed in many research institutions. The method used to grade, varies form one system to another, and one of the popular system is the Latent Semantic Analysis (LSA). LSA is a method of grading essay by extracting words and representing the sentence in the form of mathematical or statistical formulation, from a text with a relatively large number of words. The grade of the essay is determined, by matching the important words to a group of words prepared by the human rater. This paper describes an effort to developed LSA, enhanced with word weighting, word order and the word synonym to improve the accuracy of grading. This system is called SIMPLE. SIMPLE is used to grade answers using bahasa Indonesia. The exam is carried out on-line through the Web. From the experiments conducted, for small classes, the conformity of grade compared to the grade of human rater lies between 69.80 % – 94.64 %, and for medium size classes the conformity lies between 77.18 % - 98.42 % with the human rater. These results are roughly proportional with the result of LSA system, which grade essay given in English. ",

keywords = "SIMPLE, latent semantic analysis, on-line examination, web",

author = "Ratna, {Anak Agung Putri} and Bagio Budiardjo and Djoko Hartanto",

year = "2007",

month = apr,

day = "1",

doi = "10.7454/mst.v11i1.435",

language = "Indonesian",

volume = "11",

pages = "5--11",

journal = "Makara Journal of Technology",

issn = "2356-4539",

number = "1",

}

TY - JOUR

T1 - SIMPLE: SISTIM PENILAI ESEI OTOMATIS UNTUK MENILAI UJIAN DALAM BAHASA INDONESIA

AU - Ratna, Anak Agung Putri

AU - Budiardjo, Bagio

AU - Hartanto, Djoko

PY - 2007/4/1

Y1 - 2007/4/1

N2 - SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination. Evaluation of study of a student is a very important aspect of an educational process. Evaluation is aimed at measuring the level of student understanding of the given lecture materials. Measuring student understanding of the course material, using essay-type exam, is generally used as the evaluation tool. In this essay-type exam, the student has to answer questions using sentences, whereby choices of possible answers are not indicated. The student has to answer the questions with his/her sentences. The answers may vary, since it reflects the student’s best thoughts of the materials. One of the weaknesses of essay-type exam is the difficulty to grade the answers and it tends to be time consuming. Currently, automatic grading systems that may speed up the grading process, are being developed in many research institutions. The method used to grade, varies form one system to another, and one of the popular system is the Latent Semantic Analysis (LSA). LSA is a method of grading essay by extracting words and representing the sentence in the form of mathematical or statistical formulation, from a text with a relatively large number of words. The grade of the essay is determined, by matching the important words to a group of words prepared by the human rater. This paper describes an effort to developed LSA, enhanced with word weighting, word order and the word synonym to improve the accuracy of grading. This system is called SIMPLE. SIMPLE is used to grade answers using bahasa Indonesia. The exam is carried out on-line through the Web. From the experiments conducted, for small classes, the conformity of grade compared to the grade of human rater lies between 69.80 % – 94.64 %, and for medium size classes the conformity lies between 77.18 % - 98.42 % with the human rater. These results are roughly proportional with the result of LSA system, which grade essay given in English.

AB - SIMPLE: System Automatic Essay Assessment for Indonesian Language Subject Examination. Evaluation of study of a student is a very important aspect of an educational process. Evaluation is aimed at measuring the level of student understanding of the given lecture materials. Measuring student understanding of the course material, using essay-type exam, is generally used as the evaluation tool. In this essay-type exam, the student has to answer questions using sentences, whereby choices of possible answers are not indicated. The student has to answer the questions with his/her sentences. The answers may vary, since it reflects the student’s best thoughts of the materials. One of the weaknesses of essay-type exam is the difficulty to grade the answers and it tends to be time consuming. Currently, automatic grading systems that may speed up the grading process, are being developed in many research institutions. The method used to grade, varies form one system to another, and one of the popular system is the Latent Semantic Analysis (LSA). LSA is a method of grading essay by extracting words and representing the sentence in the form of mathematical or statistical formulation, from a text with a relatively large number of words. The grade of the essay is determined, by matching the important words to a group of words prepared by the human rater. This paper describes an effort to developed LSA, enhanced with word weighting, word order and the word synonym to improve the accuracy of grading. This system is called SIMPLE. SIMPLE is used to grade answers using bahasa Indonesia. The exam is carried out on-line through the Web. From the experiments conducted, for small classes, the conformity of grade compared to the grade of human rater lies between 69.80 % – 94.64 %, and for medium size classes the conformity lies between 77.18 % - 98.42 % with the human rater. These results are roughly proportional with the result of LSA system, which grade essay given in English.

KW - SIMPLE

KW - latent semantic analysis

KW - on-line examination

KW - web

UR - http://journal.ui.ac.id/index.php/technology/article/view/435

U2 - 10.7454/mst.v11i1.435

DO - 10.7454/mst.v11i1.435

M3 - Article

SN - 2356-4539

VL - 11

SP - 5

EP - 11

JO - Makara Journal of Technology

JF - Makara Journal of Technology

IS - 1

ER -

SIMPLE: SISTIM PENILAI ESEI OTOMATIS UNTUK MENILAI UJIAN DALAM BAHASA INDONESIA

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this