NusaCrowd: Open Source Initiative for Indonesian NLP Resources

Samuel Cahyawijaya; Holy Lovenia; Alham Fikri Aji; Genta Indra Winata; Bryan Wilie; Fajri Koto; Rahmad Mahendra; Christian Wibisono; Ade Romadhony; Karissa Vincentio; Jennifer Santoso; David Moeljadi; Cahya Wirawan; Frederikus Hudi; Muhammad Satrio Wicaksono; Ivan Halim Parmonangan; Ika Alfina; Ilham Firdausi Putra; Samsul Rahmadani; Yulianti Oenang; Ali Akbar Septiandri; James Jaya; Kaustubh D. Dhole; Arie Ardiyanti Suryani; Rifki Afina Putri; Dan Su; Keith Stevens; Made Nindyatama Nityasya; Muhammad Farid Adilazuarda; Ryan Ignatius; Ryandito Diandaru; Vito Ghifari; Tiezheng Yu; Wenliang Dai; Yan Xu; Dyah Damapuspita; Haryo Akbarianto Wibowo; Cuk Tho; Ichwanul Muslim Karo Karo; Tirana Noor Fatyanosa; Ziwei Ji; Graham Neubig; Timothy Baldwin; Sebastian Ruder; Pascale Fung; Herry Sujaini; Sakriani Sakti; Ayu Purwarianti

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Fajri Koto, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Muhammad Satrio Wicaksono, Ivan Halim Parmonangan, Ika Alfina, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti OenangAli Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Ignatius, Ryandito Diandaru, Vito Ghifari, Tiezheng Yu, Wenliang Dai, Yan Xu, Dyah Damapuspita, Haryo Akbarianto Wibowo, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Noor Fatyanosa, Ziwei Ji, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Pascale Fung, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Citations (Scopus)

Abstract

We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources. Through this initiative, we have brought together 137 datasets and 118 standardized data loaders. The quality of the datasets has been assessed manually and automatically, and their value is demonstrated through multiple experiments. NusaCrowd's data collection enables the creation of the first zero-shot benchmarks for natural language understanding and generation in Indonesian and the local languages of Indonesia. Furthermore, NusaCrowd brings the creation of the first multilingual automatic speech recognition benchmark in Indonesian and the local languages of Indonesia. Our work strives to advance natural language processing (NLP) research for languages that are underrepresented despite being widely spoken.

Original language	English
Title of host publication	Findings of the Association for Computational Linguistics, ACL 2023
Publisher	Association for Computational Linguistics (ACL)
Pages	13745-13819
Number of pages	75
ISBN (Electronic)	9781959429623
Publication status	Published - 2023
Event	61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 - Toronto, Canada Duration: 9 Jul 2023 → 14 Jul 2023

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	61st Annual Meeting of the Association for Computational Linguistics, ACL 2023
Country/Territory	Canada
City	Toronto
Period	9/07/23 → 14/07/23

Cite this

Cahyawijaya, S., Lovenia, H., Aji, A. F., Winata, G. I., Wilie, B., Koto, F., Mahendra, R., Wibisono, C., Romadhony, A., Vincentio, K., Santoso, J., Moeljadi, D., Wirawan, C., Hudi, F., Wicaksono, M. S., Parmonangan, I. H., Alfina, I., Putra, I. F., Rahmadani, S., ... Purwarianti, A. (2023). NusaCrowd: Open Source Initiative for Indonesian NLP Resources. In Findings of the Association for Computational Linguistics, ACL 2023 (pp. 13745-13819). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL).

@inproceedings{2d7ec7019aae4b4ba74bbaccb9318fde,

title = "NusaCrowd: Open Source Initiative for Indonesian NLP Resources",

abstract = "We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources. Through this initiative, we have brought together 137 datasets and 118 standardized data loaders. The quality of the datasets has been assessed manually and automatically, and their value is demonstrated through multiple experiments. NusaCrowd's data collection enables the creation of the first zero-shot benchmarks for natural language understanding and generation in Indonesian and the local languages of Indonesia. Furthermore, NusaCrowd brings the creation of the first multilingual automatic speech recognition benchmark in Indonesian and the local languages of Indonesia. Our work strives to advance natural language processing (NLP) research for languages that are underrepresented despite being widely spoken.",

author = "Samuel Cahyawijaya and Holy Lovenia and Aji, {Alham Fikri} and Winata, {Genta Indra} and Bryan Wilie and Fajri Koto and Rahmad Mahendra and Christian Wibisono and Ade Romadhony and Karissa Vincentio and Jennifer Santoso and David Moeljadi and Cahya Wirawan and Frederikus Hudi and Wicaksono, {Muhammad Satrio} and Parmonangan, {Ivan Halim} and Ika Alfina and Putra, {Ilham Firdausi} and Samsul Rahmadani and Yulianti Oenang and Septiandri, {Ali Akbar} and James Jaya and Dhole, {Kaustubh D.} and Suryani, {Arie Ardiyanti} and Putri, {Rifki Afina} and Dan Su and Keith Stevens and Nityasya, {Made Nindyatama} and Adilazuarda, {Muhammad Farid} and Ryan Ignatius and Ryandito Diandaru and Vito Ghifari and Tiezheng Yu and Wenliang Dai and Yan Xu and Dyah Damapuspita and Wibowo, {Haryo Akbarianto} and Cuk Tho and Karo, {Ichwanul Muslim Karo} and Fatyanosa, {Tirana Noor} and Ziwei Ji and Graham Neubig and Timothy Baldwin and Sebastian Ruder and Pascale Fung and Herry Sujaini and Sakriani Sakti and Ayu Purwarianti",

note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 ; Conference date: 09-07-2023 Through 14-07-2023",

year = "2023",

language = "English",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics (ACL)",

pages = "13745--13819",

booktitle = "Findings of the Association for Computational Linguistics, ACL 2023",

address = "United States",

}

Cahyawijaya, S, Lovenia, H, Aji, AF, Winata, GI, Wilie, B, Koto, F, Mahendra, R, Wibisono, C, Romadhony, A, Vincentio, K, Santoso, J, Moeljadi, D, Wirawan, C, Hudi, F, Wicaksono, MS, Parmonangan, IH, Alfina, I, Putra, IF, Rahmadani, S, Oenang, Y, Septiandri, AA, Jaya, J, Dhole, KD, Suryani, AA, Putri, RA, Su, D, Stevens, K, Nityasya, MN, Adilazuarda, MF, Ignatius, R, Diandaru, R, Ghifari, V, Yu, T, Dai, W, Xu, Y, Damapuspita, D, Wibowo, HA, Tho, C, Karo, IMK, Fatyanosa, TN, Ji, Z, Neubig, G, Baldwin, T, Ruder, S, Fung, P, Sujaini, H, Sakti, S & Purwarianti, A 2023, NusaCrowd: Open Source Initiative for Indonesian NLP Resources. in Findings of the Association for Computational Linguistics, ACL 2023. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), pp. 13745-13819, 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023, Toronto, Canada, 9/07/23.

NusaCrowd: Open Source Initiative for Indonesian NLP Resources. / Cahyawijaya, Samuel; Lovenia, Holy; Aji, Alham Fikri et al.
Findings of the Association for Computational Linguistics, ACL 2023. Association for Computational Linguistics (ACL), 2023. p. 13745-13819 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - NusaCrowd

T2 - 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023

AU - Cahyawijaya, Samuel

AU - Lovenia, Holy

AU - Aji, Alham Fikri

AU - Winata, Genta Indra

AU - Wilie, Bryan

AU - Koto, Fajri

AU - Mahendra, Rahmad

AU - Wibisono, Christian

AU - Romadhony, Ade

AU - Vincentio, Karissa

AU - Santoso, Jennifer

AU - Moeljadi, David

AU - Wirawan, Cahya

AU - Hudi, Frederikus

AU - Wicaksono, Muhammad Satrio

AU - Parmonangan, Ivan Halim

AU - Alfina, Ika

AU - Putra, Ilham Firdausi

AU - Rahmadani, Samsul

AU - Oenang, Yulianti

AU - Septiandri, Ali Akbar

AU - Jaya, James

AU - Dhole, Kaustubh D.

AU - Suryani, Arie Ardiyanti

AU - Putri, Rifki Afina

AU - Su, Dan

AU - Stevens, Keith

AU - Nityasya, Made Nindyatama

AU - Adilazuarda, Muhammad Farid

AU - Ignatius, Ryan

AU - Diandaru, Ryandito

AU - Ghifari, Vito

AU - Yu, Tiezheng

AU - Dai, Wenliang

AU - Xu, Yan

AU - Damapuspita, Dyah

AU - Wibowo, Haryo Akbarianto

AU - Tho, Cuk

AU - Karo, Ichwanul Muslim Karo

AU - Fatyanosa, Tirana Noor

AU - Ji, Ziwei

AU - Neubig, Graham

AU - Baldwin, Timothy

AU - Ruder, Sebastian

AU - Fung, Pascale

AU - Sujaini, Herry

AU - Sakti, Sakriani

AU - Purwarianti, Ayu

PY - 2023

Y1 - 2023

N2 - We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources. Through this initiative, we have brought together 137 datasets and 118 standardized data loaders. The quality of the datasets has been assessed manually and automatically, and their value is demonstrated through multiple experiments. NusaCrowd's data collection enables the creation of the first zero-shot benchmarks for natural language understanding and generation in Indonesian and the local languages of Indonesia. Furthermore, NusaCrowd brings the creation of the first multilingual automatic speech recognition benchmark in Indonesian and the local languages of Indonesia. Our work strives to advance natural language processing (NLP) research for languages that are underrepresented despite being widely spoken.

AB - We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources. Through this initiative, we have brought together 137 datasets and 118 standardized data loaders. The quality of the datasets has been assessed manually and automatically, and their value is demonstrated through multiple experiments. NusaCrowd's data collection enables the creation of the first zero-shot benchmarks for natural language understanding and generation in Indonesian and the local languages of Indonesia. Furthermore, NusaCrowd brings the creation of the first multilingual automatic speech recognition benchmark in Indonesian and the local languages of Indonesia. Our work strives to advance natural language processing (NLP) research for languages that are underrepresented despite being widely spoken.

UR - http://www.scopus.com/inward/record.url?scp=85174793222&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85174793222

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 13745

EP - 13819

BT - Findings of the Association for Computational Linguistics, ACL 2023

PB - Association for Computational Linguistics (ACL)

Y2 - 9 July 2023 through 14 July 2023

ER -

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this