Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings

Syandra Sari; Mirna Adriani

doi:10.1145/3373477.3373493

Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings

Syandra Sari, Mirna Adriani

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

This work applied word embeddings for English monolingual information retrieval and Dutch-English cross-language information retrieval. Besides word embeddings, this work also applied tf-idf concept to increase result of relevant documents. We present experiments using four techniques adapted from tf-idf concept. The result showed additional techniques could increase MAP score up to 26.6% in monolingual information retrieval and up to 26.2% in cross-language information retrieval compare with monolingual information retrieval and cross-language information retrieval using average vectors technique only.

Original language	English
Title of host publication	Proceedings of the International Conference on Advanced Information Science and System, AISS 2019
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450372916
DOIs	https://doi.org/10.1145/3373477.3373493
Publication status	Published - 15 Nov 2019
Event	2019 International Conference on Advanced Information Science and System, AISS 2019 - Singapore, Singapore Duration: 15 Nov 2019 → 17 Nov 2019

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	2019 International Conference on Advanced Information Science and System, AISS 2019
Country/Territory	Singapore
City	Singapore
Period	15/11/19 → 17/11/19

Keywords

Cross-Language Information Retrieval
Cross-Lingual Word Embeddings
Monolingual Information Retrieval
Tf-Idf
Word Embeddings

Access to Document

10.1145/3373477.3373493

Cite this

Sari, S., & Adriani, M. (2019). Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings. In Proceedings of the International Conference on Advanced Information Science and System, AISS 2019 (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3373477.3373493

@inproceedings{534d0b18dcce481ba2627a013821d7f5,

title = "Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings",

abstract = "This work applied word embeddings for English monolingual information retrieval and Dutch-English cross-language information retrieval. Besides word embeddings, this work also applied tf-idf concept to increase result of relevant documents. We present experiments using four techniques adapted from tf-idf concept. The result showed additional techniques could increase MAP score up to 26.6% in monolingual information retrieval and up to 26.2% in cross-language information retrieval compare with monolingual information retrieval and cross-language information retrieval using average vectors technique only.",

keywords = "Cross-Language Information Retrieval, Cross-Lingual Word Embeddings, Monolingual Information Retrieval, Tf-Idf, Word Embeddings",

author = "Syandra Sari and Mirna Adriani",

note = "Publisher Copyright: {\textcopyright} 2019 Association for Computing Machinery.; 2019 International Conference on Advanced Information Science and System, AISS 2019 ; Conference date: 15-11-2019 Through 17-11-2019",

year = "2019",

month = nov,

day = "15",

doi = "10.1145/3373477.3373493",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

booktitle = "Proceedings of the International Conference on Advanced Information Science and System, AISS 2019",

}

Sari, S & Adriani, M 2019, Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings. in Proceedings of the International Conference on Advanced Information Science and System, AISS 2019. ACM International Conference Proceeding Series, Association for Computing Machinery, 2019 International Conference on Advanced Information Science and System, AISS 2019, Singapore, Singapore, 15/11/19. https://doi.org/10.1145/3373477.3373493

Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings. / Sari, Syandra; Adriani, Mirna.
Proceedings of the International Conference on Advanced Information Science and System, AISS 2019. Association for Computing Machinery, 2019. (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings

AU - Sari, Syandra

AU - Adriani, Mirna

PY - 2019/11/15

Y1 - 2019/11/15

N2 - This work applied word embeddings for English monolingual information retrieval and Dutch-English cross-language information retrieval. Besides word embeddings, this work also applied tf-idf concept to increase result of relevant documents. We present experiments using four techniques adapted from tf-idf concept. The result showed additional techniques could increase MAP score up to 26.6% in monolingual information retrieval and up to 26.2% in cross-language information retrieval compare with monolingual information retrieval and cross-language information retrieval using average vectors technique only.

AB - This work applied word embeddings for English monolingual information retrieval and Dutch-English cross-language information retrieval. Besides word embeddings, this work also applied tf-idf concept to increase result of relevant documents. We present experiments using four techniques adapted from tf-idf concept. The result showed additional techniques could increase MAP score up to 26.6% in monolingual information retrieval and up to 26.2% in cross-language information retrieval compare with monolingual information retrieval and cross-language information retrieval using average vectors technique only.

KW - Cross-Language Information Retrieval

KW - Cross-Lingual Word Embeddings

KW - Monolingual Information Retrieval

KW - Tf-Idf

KW - Word Embeddings

UR - http://www.scopus.com/inward/record.url?scp=85123042121&partnerID=8YFLogxK

U2 - 10.1145/3373477.3373493

DO - 10.1145/3373477.3373493

M3 - Conference contribution

AN - SCOPUS:85123042121

T3 - ACM International Conference Proceeding Series

BT - Proceedings of the International Conference on Advanced Information Science and System, AISS 2019

PB - Association for Computing Machinery

T2 - 2019 International Conference on Advanced Information Science and System, AISS 2019

Y2 - 15 November 2019 through 17 November 2019

ER -

Applications of Tf-idf concept to improve monolingual and cross-language information retrieval based on word embeddings

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this