Tourism-Dermayon: A Basic Model for Development of Basa Dermayu Language Model

DOI

10.2991/978-94-6463-938-4_65How to use a DOI?

Keywords

Fine-tuning; Low-resource language; Synthetic data generation; Tourism Chatbot; Tourism Indramayu

Abstract

Indramayu Language or Basa Dermayu is a Javanese language spoken by the people of Indramayu. The dialect differences between Basa Dermayu and Standard Javanese pose a challenge in developing a large language model (LLM) for Basa Dermayu, which is currently not available. This study aims to develop an LLM for Basa Dermayu to support tourism and cultural needs in Indramayu by implementing it in a chatbot application. The model was built using a pre-trained LLM that was fine-tuned with a dataset concerning tourism and culture in Indramayu. The selection of tourism and cultural topics for the dataset was based on prior research related to the promotion of tourism and culture in Indramayu. The dataset was created using artificial intelligence (AI) tools and then manually annotated by native Basa Dermayu speakers. Experimental results indicate that, although not yet optimal, achieving an average ROUGE score of 26.4%, the results are reasonably favorable when compared with the baseline model prior to fine-tuning. The contribution of this study lies in the development of a pre-trained LLM for Basa Dermayu, which can serve as a baseline for future development of Basa Dermayu LLMs.

Copyright

© 2025 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Denny Firmansyah Suwardi
AU  - Mohammad Yani
AU  - Muhamad Mustamiin
AU  - Robieth Sohiburoyyan
AU  - Vera Wati
PY  - 2025
DA  - 2025/12/31
TI  - Tourism-Dermayon: A Basic Model for Development of Basa Dermayu Language Model
BT  - Proceedings of the International Conference on Applied Science and Technology on Social Science 2025 (iCAST-SS 2025
PB  - Atlantis Press
SP  - 577
EP  - 585
SN  - 2352-5428
UR  - https://doi.org/10.2991/978-94-6463-938-4_65
DO  - 10.2991/978-94-6463-938-4_65
ID  - Suwardi2025
ER  -