Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF

Dipta Tanaya; Mirna Adriani

doi:10.1109/IALP.2018.8629215

Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF

Dipta Tanaya, Mirna Adriani

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

Word segmentation method based on dictionary for Javanese character still cannot overcome the problem of ambiguity, derivational word segmentation, and unknown words identification. We propose a new approach for Javanese character segmentation, i.e. a machine learning based method using CRF and SVM with a set feature of Javanese character's categorization and its combination with dictionary-based method. Through several experiments, it is proven that combination of dictionary-based method and CRF performs best than word segmentation using CRF, SVM, and traditional dictionary-based word segmentation.

Original language	English
Title of host publication	Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018
Editors	Minghui Dong, Moch. Bijaksana, Herry Sujaini, Arif Bijaksana Putra Negara, Ade Romadhony, Fariska Z. Ruskanda, Elvira Nurfadhilah, Lyla Ruslana Aini
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	240-243
Number of pages	4
ISBN (Electronic)	9781728111766
DOIs	https://doi.org/10.1109/IALP.2018.8629215
Publication status	Published - 2 Jul 2018
Event	22nd International Conference on Asian Language Processing, IALP 2018 - Bandung, Indonesia Duration: 15 Nov 2018 → 17 Nov 2018

Publication series

Name	Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018

Conference

Conference	22nd International Conference on Asian Language Processing, IALP 2018
Country/Territory	Indonesia
City	Bandung
Period	15/11/18 → 17/11/18

Keywords

Javanese character
conditional random field
support vector machine
word segmentation

Access to Document

10.1109/IALP.2018.8629215

Cite this

Tanaya, D., & Adriani, M. (2018). Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF. In M. Dong, M. Bijaksana, H. Sujaini, A. B. P. Negara, A. Romadhony, F. Z. Ruskanda, E. Nurfadhilah, & L. R. Aini (Eds.), Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018 (pp. 240-243). Article 8629215 (Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IALP.2018.8629215

Tanaya, Dipta ; Adriani, Mirna. / Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF. Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018. editor / Minghui Dong ; Moch. Bijaksana ; Herry Sujaini ; Arif Bijaksana Putra Negara ; Ade Romadhony ; Fariska Z. Ruskanda ; Elvira Nurfadhilah ; Lyla Ruslana Aini. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 240-243 (Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018).

@inproceedings{970589110e564195b0edb282826094fd,

title = "Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF",

abstract = "Word segmentation method based on dictionary for Javanese character still cannot overcome the problem of ambiguity, derivational word segmentation, and unknown words identification. We propose a new approach for Javanese character segmentation, i.e. a machine learning based method using CRF and SVM with a set feature of Javanese character's categorization and its combination with dictionary-based method. Through several experiments, it is proven that combination of dictionary-based method and CRF performs best than word segmentation using CRF, SVM, and traditional dictionary-based word segmentation.",

keywords = "Javanese character, conditional random field, support vector machine, word segmentation",

author = "Dipta Tanaya and Mirna Adriani",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 22nd International Conference on Asian Language Processing, IALP 2018 ; Conference date: 15-11-2018 Through 17-11-2018",

year = "2018",

month = jul,

day = "2",

doi = "10.1109/IALP.2018.8629215",

language = "English",

series = "Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "240--243",

editor = "Minghui Dong and Moch. Bijaksana and Herry Sujaini and Negara, {Arif Bijaksana Putra} and Ade Romadhony and Ruskanda, {Fariska Z.} and Elvira Nurfadhilah and Aini, {Lyla Ruslana}",

booktitle = "Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018",

address = "United States",

}

Tanaya, D & Adriani, M 2018, Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF. in M Dong, M Bijaksana, H Sujaini, ABP Negara, A Romadhony, FZ Ruskanda, E Nurfadhilah & LR Aini (eds), Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018., 8629215, Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018, Institute of Electrical and Electronics Engineers Inc., pp. 240-243, 22nd International Conference on Asian Language Processing, IALP 2018, Bandung, Indonesia, 15/11/18. https://doi.org/10.1109/IALP.2018.8629215

Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF. / Tanaya, Dipta; Adriani, Mirna.
Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018. ed. / Minghui Dong; Moch. Bijaksana; Herry Sujaini; Arif Bijaksana Putra Negara; Ade Romadhony; Fariska Z. Ruskanda; Elvira Nurfadhilah; Lyla Ruslana Aini. Institute of Electrical and Electronics Engineers Inc., 2018. p. 240-243 8629215 (Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF

AU - Tanaya, Dipta

AU - Adriani, Mirna

PY - 2018/7/2

Y1 - 2018/7/2

N2 - Word segmentation method based on dictionary for Javanese character still cannot overcome the problem of ambiguity, derivational word segmentation, and unknown words identification. We propose a new approach for Javanese character segmentation, i.e. a machine learning based method using CRF and SVM with a set feature of Javanese character's categorization and its combination with dictionary-based method. Through several experiments, it is proven that combination of dictionary-based method and CRF performs best than word segmentation using CRF, SVM, and traditional dictionary-based word segmentation.

AB - Word segmentation method based on dictionary for Javanese character still cannot overcome the problem of ambiguity, derivational word segmentation, and unknown words identification. We propose a new approach for Javanese character segmentation, i.e. a machine learning based method using CRF and SVM with a set feature of Javanese character's categorization and its combination with dictionary-based method. Through several experiments, it is proven that combination of dictionary-based method and CRF performs best than word segmentation using CRF, SVM, and traditional dictionary-based word segmentation.

KW - Javanese character

KW - conditional random field

KW - support vector machine

KW - word segmentation

UR - http://www.scopus.com/inward/record.url?scp=85062811125&partnerID=8YFLogxK

U2 - 10.1109/IALP.2018.8629215

DO - 10.1109/IALP.2018.8629215

M3 - Conference contribution

AN - SCOPUS:85062811125

T3 - Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018

SP - 240

EP - 243

BT - Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018

A2 - Dong, Minghui

A2 - Bijaksana, Moch.

A2 - Sujaini, Herry

A2 - Negara, Arif Bijaksana Putra

A2 - Romadhony, Ade

A2 - Ruskanda, Fariska Z.

A2 - Nurfadhilah, Elvira

A2 - Aini, Lyla Ruslana

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 22nd International Conference on Asian Language Processing, IALP 2018

Y2 - 15 November 2018 through 17 November 2018

ER -

Tanaya D, Adriani M. Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF. In Dong M, Bijaksana M, Sujaini H, Negara ABP, Romadhony A, Ruskanda FZ, Nurfadhilah E, Aini LR, editors, Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 240-243. 8629215. (Proceedings of the 2018 International Conference on Asian Language Processing, IALP 2018). doi: 10.1109/IALP.2018.8629215

Word Segmentation for Javanese Character Using Dictionary, SVM, and CRF

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this