Deploying Large Language Models in New Media Cultural Interaction: A Multimodal Framework Based on the Guangzhou Flower Market

DOI

10.2991/978-2-38476-497-6_4How to use a DOI?

Keywords

Cultural Narrative; Large Language Model; Multimodal Interaction; TouchDesigner; Interactive Heritage exhibit; AI-assisted Cultural Preservation

Abstract

As digital technologies increasingly reshape how cultural memory is shared and preserved, this paper proposes an exploratory design framework that fuses Large Language Models (LLMs) with multimodal interactive systems to revitalise intangible cultural heritage through real-time, context-aware storytelling. Using Guangzhou’s Spring Flower Market as a case study, we integrate an LLM-driven semantic engine with TouchDesigner and Kinect sensing to translate textual or spoken cultural prompts into visually coherent, emotionally resonant generative scenes. The approach addresses persistent limitations of gesture-only installations—shallow narrative depth and fragmented visual style. By allowing the LLM to interpret developer intent and audience input, our system dynamically assembles node graphs that maintain cultural symbolism while adapting to user interaction, thereby lowering technical barriers for artists and enhancing visitor engagement. We outline the system architecture, present a prototype deployment, and discuss ethical considerations surrounding AI-mediated heritage narration.

Copyright

© 2025 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Yifei Lai
AU  - Xiaolin Zhang
AU  - Yonghao Long
AU  - Xinyun Zhou
AU  - Rubing Wu
AU  - Yalan Liu
AU  - Mengyi Xia
PY  - 2025
DA  - 2025/12/15
TI  - Deploying Large Language Models in New Media Cultural Interaction: A Multimodal Framework Based on the Guangzhou Flower Market
BT  - Proceedings of the 2025 International Conference on Educational Innovation and Information Technology (EIIT 2025)
PB  - Atlantis Press
SP  - 26
EP  - 37
SN  - 2352-5398
UR  - https://doi.org/10.2991/978-2-38476-497-6_4
DO  - 10.2991/978-2-38476-497-6_4
ID  - Lai2025
ER  -