XR Gesture/Eye Movement/Voice/Touch Multimodal Interaction in Immersive Entertainment Application and Experience Optimization

DOI

10.2991/978-2-38476-609-3_64How to use a DOI?

Keywords

Extended reality; Multimodal interaction; Immersive entertainment

Abstract

With the rapid development of emerging technologies oriented by meta universe and virtual reality, XR technology generated by multiple integration is promoting the continuous development of games, virtual performances, immersive social networking and other scenes. The traditional single modal interaction mode still has shortcomings and limitations in naturalness, immersion and operation efficiency, and it is difficult to adapt to the complex needs of users in the current virtual environment, so multimodal interaction has become the key technology path to improve the experience. In this paper, XR multimodal interaction, which integrates gestures, eye movements, voice and touch, is the research object. Through a separate and overall analysis of multimodal interaction cases such as gestures, it shows its unlimited potential in immersive entertainment (games, virtual performances and other scenes), and systematically combs its application status in immersive entertainment. Around the dimensions of interaction accuracy, response delay, immersion matching, etc., it summarizes the optimization strategies for existing experience. On this basis, the future development directions of emotional perception, intelligent adaptive interaction, lightweight hardware integration and high fidelity tactile feedback are prospected, and theoretical reference and ideas are provided for the interaction design optimization, technology implementation and industrial upgrading of XR immersive entertainment.

Copyright

© 2026 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Jiayi Wang
AU  - Xuanming Wang
PY  - 2026
DA  - 2026/09/04
TI  - XR Gesture/Eye Movement/Voice/Touch Multimodal Interaction in Immersive Entertainment Application and Experience Optimization
BT  - Proceedings of the 2026 3rd International Conference on Public Relations and Media Communication (PRMC 2026)
PB  - Atlantis Press
SP  - 601
EP  - 610
SN  - 2352-5398
UR  - https://doi.org/10.2991/978-2-38476-609-3_64
DO  - 10.2991/978-2-38476-609-3_64
ID  - Wang2026
ER  -